-- Logs begin at Tue 2021-11-16 02:37:37 UTC, end at Tue 2021-11-16 03:37:30 UTC. -- Nov 16 03:08:26.518308 dv-cinder-818037-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 16 03:08:29.230998 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.common.config [-] Logging enabled! Nov 16 03:08:29.231630 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev179 Nov 16 03:08:29.231728 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101791) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 16 03:08:29.234995 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.common.config [-] Logging enabled! Nov 16 03:08:29.235237 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev179 Nov 16 03:08:29.235539 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101791) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 16 03:08:29.236468 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 03:08:29.236695 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 03:08:29.237044 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 03:08:29.237281 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 03:08:29.237517 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 03:08:29.237822 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.238236 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 16 03:08:29.238533 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.238817 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.239082 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.239365 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.239642 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.239914 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.240186 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.240477 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.240755 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.241023 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.241295 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.241602 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.241857 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] config_source = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.242132 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.242407 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.242677 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] debug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.242947 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.243419 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.243829 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.244100 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.244379 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.244652 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.244911 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.245178 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.245468 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.245790 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] host = dv-cinder-818037-1-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.246054 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.246328 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.246601 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.246875 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.247146 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.247404 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.247675 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.247935 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_dir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.248197 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.248462 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.248737 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.249011 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.249295 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.249536 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.249757 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.250032 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.250306 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.250572 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.250840 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.251104 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.251367 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.251628 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.251886 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.252163 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.252437 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.252708 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.252974 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.253235 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.253521 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.253782 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.254054 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.254317 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.254577 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.254837 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.255110 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.255367 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.255626 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.255911 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.256187 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.256460 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.256730 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.256992 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.257261 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.257549 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.257815 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] use_journal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.258078 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] use_json = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.258341 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.258600 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.258982 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.259251 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.259509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.259771 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.260035 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.260309 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:29.260597 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.260923 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.261176 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.261468 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.261760 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.262029 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.262305 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.262584 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.262884 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.263162 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.263439 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.263686 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.263988 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.264254 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.264533 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.264825 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.265107 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.265385 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.265653 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.265915 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.266176 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.266441 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.266715 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.266981 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.267254 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.267524 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.267773 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.268047 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.268327 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.268603 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.268865 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.269134 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.269411 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.269707 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.269969 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.270240 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.270515 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.270789 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.271054 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.271325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.271590 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.271852 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.272117 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.272389 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.272667 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.272934 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.273194 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.273484 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.273758 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.274019 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.274318 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.274586 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.274934 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.275202 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.275794 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.276065 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.276330 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.276603 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.276872 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.277142 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.277401 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.277687 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.277951 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.278215 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.278478 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.278740 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.279004 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.279270 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.279530 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.279793 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.280054 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.280321 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.280583 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.280862 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.281157 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.281445 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.281718 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.281986 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.282255 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.282528 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.282795 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.283060 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.283328 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.283589 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.283874 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.284148 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.284428 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.284710 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.284974 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.285681 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.285947 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.286221 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.286486 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.286755 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.287029 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.287304 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.287585 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.287866 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.288147 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.288427 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.288713 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.288982 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.289282 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.289574 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:29.289785 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 03:08:29.290238 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=101791) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 16 03:08:29.725474 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 03:08:29.725716 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 03:08:29.726039 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 03:08:29.726371 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 16 03:08:30.054651 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.054950 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.055046 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.056349 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.056612 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.056981 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.091318 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.091550 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.091799 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.109152 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.109389 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.109710 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.139351 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.139574 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.139853 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.177328 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.177595 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.177877 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.414582 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.415299 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.415299 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.415299 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.416100 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.544599 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.544906 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.545183 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.545474 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.545732 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.546032 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.546282 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.546526 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.546775 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.547040 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.547275 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.547531 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.547773 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.548019 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.548263 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.548517 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.548746 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.549004 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.549263 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.549534 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.549793 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.550036 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.550315 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.550681 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.550920 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.551163 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.551561 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:30.551794 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:30.552024 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:30.552252 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:30.552477 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:30.552701 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:30.553065 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 16 03:08:30.556580 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 16 03:08:30.560538 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 16 03:08:30.564702 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(300, 349)])]) Nov 16 03:08:30.566352 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 16 03:08:30.566813 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 16 03:08:30.567141 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 16 03:08:30.567518 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 16 03:08:30.570372 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 16 03:08:30.570613 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 16 03:08:30.570954 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 16 03:08:30.576315 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 16 03:08:30.598842 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 16 03:08:30.599302 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.599595 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=101791) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:89}} Nov 16 03:08:30.599962 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.601336 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=101791) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 16 03:08:30.601638 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 16 03:08:30.601850 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 16 03:08:30.605140 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.605413 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:30.668369 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 16 03:08:30.668520 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 16 03:08:30.668751 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 16 03:08:30.669126 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 16 03:08:30.689839 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 03:08:31.238062 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing driver for type 'gre' Nov 16 03:08:31.238585 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] gre ID ranges: [(1, 1000)] Nov 16 03:08:31.295863 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing driver for type 'local' Nov 16 03:08:31.296252 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing driver for type 'vlan' Nov 16 03:08:31.316261 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] VlanTypeDriver initialization complete Nov 16 03:08:31.316640 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing driver for type 'vxlan' Nov 16 03:08:31.317162 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] vxlan ID ranges: [(1, 1000)] Nov 16 03:08:31.384136 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing extension driver 'port_security' Nov 16 03:08:31.384459 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.extensions.port_security [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] PortSecurityExtensionDriver initialization complete Nov 16 03:08:31.384791 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing mechanism driver 'openvswitch' Nov 16 03:08:31.385176 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing mechanism driver 'hyperv' Nov 16 03:08:31.392067 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.plugin [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=101791) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:08:31.392945 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.393318 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.393763 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.394314 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=101791) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 16 03:08:31.394741 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.395084 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.395423 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.395805 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=101791) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 16 03:08:31.396197 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.396537 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.396868 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.397248 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=101791) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 16 03:08:31.397665 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > security_group after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.398008 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > security_group after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.398338 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > security_group after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.398722 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=101791) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 16 03:08:31.399116 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.399502 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.399835 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.400218 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=101791) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 16 03:08:31.400616 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > address_group after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.400957 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > address_group after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.401286 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > address_group after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.401700 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=101791) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 16 03:08:31.402079 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] ML2 OVO RPC backend initialized. {{(pid=101791) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 16 03:08:31.402825 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_interface after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.403173 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.403582 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.403919 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > networks before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.404254 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.404584 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > ports before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.404917 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.405244 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnets before_response 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.405614 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.405943 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.406267 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.406593 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.406919 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.407258 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.407578 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.407900 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.408224 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > subnet after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.408825 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.plugin [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Modular L2 Plugin initialization complete Nov 16 03:08:31.409147 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading services supported by the core plugin {{(pid=101791) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 16 03:08:31.409498 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.plugins.ml2.managers [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Got port-security extension from driver 'port_security' Nov 16 03:08:31.409954 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.extensions.vlantransparent [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Disabled vlantransparent extension. Nov 16 03:08:31.410792 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=101791) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 16 03:08:31.411092 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: router Nov 16 03:08:31.450238 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_interface before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.450899 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_create 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.451023 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router before_create 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.451309 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.451688 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.452033 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_delete 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.452385 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > floatingip after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.452838 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > floatingip after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.453198 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_create 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.453569 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_update 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.453913 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_update 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.454259 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.454614 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_update 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.455014 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_update 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.455379 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.455706 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.456045 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: subnet after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.456350 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.456684 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > port precommit_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.457027 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_create 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.457359 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.457793 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.458141 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router after_update 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.458473 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_delete 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.458821 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_create 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.459174 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router_interface after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.459513 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_update 55549900 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.459869 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > agent after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.460206 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > agent after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.460546 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > network after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.461479 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Tracking information for resource: router configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:31.461868 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Tracking information for resource: floatingip configured {{(pid=101791) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 16 03:08:31.467189 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.db.l3_agentschedulers_db [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 16 03:08:31.467768 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.468115 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port after_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.468452 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port after_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.468793 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: port after_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.469629 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router before_create 55550100 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.469980 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_delete 55550100 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.470330 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_create 55550100 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.470670 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > router precommit_update 55550100 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.475653 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.provider_configuration [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service providers = [] {{(pid=101791) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 16 03:08:31.476010 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.db.servicetype_db [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=101791) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 16 03:08:31.479122 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.service_base [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=101791) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 16 03:08:31.479461 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.service_base [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=101791) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 16 03:08:31.479792 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.service_base [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=101791) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 16 03:08:31.480694 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.services.service_base [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=101791) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 16 03:08:31.481053 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.services.service_base [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 16 03:08:31.481446 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.481777 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 16 03:08:31.492710 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.493014 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: auto_allocate Nov 16 03:08:31.499066 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: network precommit_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.499434 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: network precommit_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.499959 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.500281 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: tag Nov 16 03:08:31.507260 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.507580 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: timestamp Nov 16 03:08:31.511538 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.511863 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: network_ip_availability Nov 16 03:08:31.517383 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.517778 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.518122 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.518858 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.519169 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: flavors Nov 16 03:08:31.524443 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.524770 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading Plugin: revisions Nov 16 03:08:31.529190 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=101791) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 16 03:08:31.529616 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_concurrency.lockutils [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.803s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 03:08:31.530364 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=101791) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 16 03:08:31.530695 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Initializing extension manager. Nov 16 03:08:31.531206 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: __init__.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.531536 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: __pycache__ {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.531862 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.532184 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: address_group.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.532940 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.533531 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: address-group Nov 16 03:08:31.533864 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: address_scope.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.534562 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.535065 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: address-scope Nov 16 03:08:31.535733 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: admin_state_down_before_update.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.536660 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.537158 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: router-admin-state-down-before-update Nov 16 03:08:31.537481 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: agent.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.538182 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.538670 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: agent Nov 16 03:08:31.538978 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: agent_resources_synced.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.539927 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.540824 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: agent-resources-synced Nov 16 03:08:31.541173 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: allowedaddresspairs.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.543025 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.543544 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: allowed-address-pairs Nov 16 03:08:31.543865 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: auto_allocated_topology.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.544947 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.545444 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: auto-allocated-topology Nov 16 03:08:31.545793 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: availability_zone.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.546470 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.546963 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: availability_zone Nov 16 03:08:31.547273 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: availability_zone_filter.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.548166 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.548650 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: availability_zone_filter Nov 16 03:08:31.548967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: data_plane_status.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.549894 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.550396 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension data-plane-status not supported by any of loaded plugins Nov 16 03:08:31.550707 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: default_subnetpools.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.551631 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.552122 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: default-subnetpools Nov 16 03:08:31.552434 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: dhcpagentscheduler.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.553260 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.553790 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: dhcp_agent_scheduler Nov 16 03:08:31.554104 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: dns.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.555011 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.555551 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension dns-integration not supported by any of loaded plugins Nov 16 03:08:31.555880 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: dns_domain_ports.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.556880 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.557376 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 16 03:08:31.557716 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.558621 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.559117 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 16 03:08:31.559426 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: dvr.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.560089 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.560587 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: dvr Nov 16 03:08:31.560894 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: ecmp_routes.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.561846 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.562353 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 16 03:08:31.562664 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: empty_string_filtering.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.563577 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.564075 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: empty-string-filtering Nov 16 03:08:31.564389 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.565307 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.565826 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 16 03:08:31.566138 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.567034 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.567526 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 16 03:08:31.567837 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: external_net.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.568742 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.569232 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: external-net Nov 16 03:08:31.569562 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: extra_dhcp_opt.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.570469 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.570964 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: extra_dhcp_opt Nov 16 03:08:31.571375 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: extraroute.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.572435 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.572936 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: extraroute Nov 16 03:08:31.573252 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: extraroute_atomic.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.574320 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.575047 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: extraroute-atomic Nov 16 03:08:31.575362 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: filter_validation.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.576029 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.576521 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: filter-validation Nov 16 03:08:31.576832 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: fip_pf_description.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.577761 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.578251 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 16 03:08:31.578567 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: fip_port_details.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.579471 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.579965 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: fip-port-details Nov 16 03:08:31.580265 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: flavors.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.581553 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.582073 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: flavors Nov 16 03:08:31.582389 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.584067 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.584597 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 16 03:08:31.584919 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: floatingip_pools.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.585653 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.586154 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: floatingip-pools Nov 16 03:08:31.586472 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: ip_allocation.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.587545 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.588046 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension ip_allocation not supported by any of loaded plugins Nov 16 03:08:31.588367 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.589281 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.589806 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: ip-substring-filtering Nov 16 03:08:31.590123 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l2_adjacency.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.591035 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.591532 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 16 03:08:31.591847 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.592840 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.593350 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: router Nov 16 03:08:31.593690 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3_conntrack_helper.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.595998 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.596516 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 16 03:08:31.596836 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.597768 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.598275 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: ext-gw-mode Nov 16 03:08:31.598590 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.599521 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.600017 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: l3-ha Nov 16 03:08:31.600333 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3_flavors.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.601241 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.601757 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: l3-flavors Nov 16 03:08:31.602072 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.603059 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.603659 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 16 03:08:31.603977 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: l3agentscheduler.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.605064 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.605610 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: l3_agent_scheduler Nov 16 03:08:31.605930 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: logging.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.607444 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.607959 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension logging not supported by any of loaded plugins Nov 16 03:08:31.608283 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: metering.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.609009 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.609611 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: metering Nov 16 03:08:31.609926 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.611153 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.611665 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: metering_source_and_destination_fields Nov 16 03:08:31.611980 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: multiprovidernet.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.612888 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.613389 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: multi-provider Nov 16 03:08:31.613733 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: netmtu.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.614634 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.615127 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: net-mtu Nov 16 03:08:31.615442 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: netmtu_writable.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.616339 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.616845 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: net-mtu-writable Nov 16 03:08:31.617156 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: network_availability_zone.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.617872 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.618492 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: network_availability_zone Nov 16 03:08:31.618826 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: network_ip_availability.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.619942 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.620438 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: network-ip-availability Nov 16 03:08:31.620748 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: network_segment_range.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.621536 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.622034 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension network-segment-range not supported by any of loaded plugins Nov 16 03:08:31.622347 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: pagination.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.623313 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.623635 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: pagination Nov 16 03:08:31.623948 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: port_device_profile.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.624838 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.625350 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: port-device-profile Nov 16 03:08:31.625681 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.626579 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.627075 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: port-mac-address-regenerate Nov 16 03:08:31.627384 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.628290 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.628800 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: port-numa-affinity-policy Nov 16 03:08:31.629106 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: port_resource_request.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.630030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.630525 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension port-resource-request not supported by any of loaded plugins Nov 16 03:08:31.630834 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: port_resource_request_groups.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.631787 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.632280 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 16 03:08:31.632592 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: portbindings.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.633544 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.634139 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: binding Nov 16 03:08:31.634453 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: portbindings_extended.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.635741 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.636244 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: binding-extended Nov 16 03:08:31.636560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: portsecurity.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.637480 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.637992 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: port-security Nov 16 03:08:31.638306 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: project_id.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.639268 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.639587 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: project-id Nov 16 03:08:31.639899 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: providernet.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.640809 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.641308 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: provider Nov 16 03:08:31.641762 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.645345 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.645891 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos not supported by any of loaded plugins Nov 16 03:08:31.646213 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.647450 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.647946 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 16 03:08:31.648282 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.649195 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.649745 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 16 03:08:31.650071 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_default.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.650977 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.651472 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-default not supported by any of loaded plugins Nov 16 03:08:31.651791 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_fip.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.652436 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.652927 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-fip not supported by any of loaded plugins Nov 16 03:08:31.653240 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_gateway_ip.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.654171 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.654673 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 16 03:08:31.654976 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_port_network_policy.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.655891 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.656393 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 16 03:08:31.656701 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.657759 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.658276 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 16 03:08:31.658585 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_pps_rule.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.659756 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.660829 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-pps not supported by any of loaded plugins Nov 16 03:08:31.661145 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_rule_type_details.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.662091 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.662591 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 16 03:08:31.662905 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: qos_rules_alias.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.663959 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.664457 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 16 03:08:31.664772 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: quota_check_limit.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.665786 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.666284 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: quota-check-limit Nov 16 03:08:31.666600 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: quotasv2.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.667574 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.667896 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: quotas Nov 16 03:08:31.668216 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: quotasv2_detail.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.671445 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.671775 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: quota_details Nov 16 03:08:31.672099 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: rbac.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.673166 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.673722 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: rbac-policies Nov 16 03:08:31.674049 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: rbac_address_group.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.674962 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.675469 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: rbac-address-group Nov 16 03:08:31.675782 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: rbac_address_scope.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.676701 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.677203 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: rbac-address-scope Nov 16 03:08:31.677550 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: rbac_security_groups.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.678461 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.678958 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: rbac-security-groups Nov 16 03:08:31.679270 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: rbac_subnetpool.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.680165 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.680877 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: rbac-subnetpool Nov 16 03:08:31.681196 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: revisionifmatch.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.682129 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.682629 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: revision-if-match Nov 16 03:08:31.682946 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: revisions.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.684077 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.684571 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: standard-attr-revisions Nov 16 03:08:31.684887 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: router_availability_zone.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.685576 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.686071 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: router_availability_zone Nov 16 03:08:31.686388 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: routerservicetype.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.687296 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.687773 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension router-service-type not supported by any of loaded plugins Nov 16 03:08:31.688101 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.689016 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.689686 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: security-groups-normalized-cidr Nov 16 03:08:31.690008 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: security_groups_port_filtering.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.690996 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.691492 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: port-security-groups-filtering Nov 16 03:08:31.691805 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.692729 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.693229 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: security-groups-remote-address-group Nov 16 03:08:31.693554 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.694481 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.694984 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: security-groups-shared-filtering Nov 16 03:08:31.695303 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.695887 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 16 03:08:31.696373 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: securitygroup.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.706388 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.706933 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: security-group Nov 16 03:08:31.707262 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: segment.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.708058 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.708541 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension segment not supported by any of loaded plugins Nov 16 03:08:31.708882 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.709867 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.710375 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 16 03:08:31.710689 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: servicetype.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.711840 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.712350 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: service-type Nov 16 03:08:31.712666 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: sorting.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.713676 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.713998 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: sorting Nov 16 03:08:31.714296 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: standard_attr_segment.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.715199 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.715703 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 16 03:08:31.716015 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: standardattrdescription.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.716657 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.717150 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: standard-attr-description Nov 16 03:08:31.717479 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: stateful_security_group.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.718420 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.718923 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: stateful-security-group Nov 16 03:08:31.719245 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: stdattrs_common.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.719803 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 16 03:08:31.720119 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.721036 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.721569 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 16 03:08:31.721883 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: subnet_onboard.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.722946 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.723453 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: subnet_onboard Nov 16 03:08:31.723767 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.724677 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.725177 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 16 03:08:31.725516 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: subnet_service_types.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.726421 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.726924 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: subnet-service-types Nov 16 03:08:31.727235 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: subnetallocation.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.728670 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.729199 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: subnet_allocation Nov 16 03:08:31.729546 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.730219 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.730727 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: subnetpool-prefix-ops Nov 16 03:08:31.731042 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.731966 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.732465 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 16 03:08:31.732784 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: tagging.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.733886 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.734402 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: standard-attr-tag Nov 16 03:08:31.734720 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: timestamp.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.735928 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.736429 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loaded extension: standard-attr-timestamp Nov 16 03:08:31.736749 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: trunk.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.737791 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.738303 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension trunk not supported by any of loaded plugins Nov 16 03:08:31.738621 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: trunk_details.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.739524 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.740024 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension trunk-details not supported by any of loaded plugins Nov 16 03:08:31.740338 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: uplink_status_propagation.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.741258 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.741784 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 16 03:08:31.742096 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Loading extension file: vlantransparent.py {{(pid=101791) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 16 03:08:31.742815 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=101791) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 16 03:08:31.743418 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 16 03:08:31.746168 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:network Nov 16 03:08:31.746710 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:subnet Nov 16 03:08:31.747098 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:subnetpool Nov 16 03:08:31.747482 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:port Nov 16 03:08:31.750076 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.750514 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service FLAVORS assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.751142 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.751561 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.751884 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:router Nov 16 03:08:31.752310 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:floatingip Nov 16 03:08:31.752785 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service METERING assigned prefix: /metering {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.754286 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.754647 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.754989 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101791) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:08:31.756004 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of CountableResource for resource:rbac_policy Nov 16 03:08:31.756441 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:security_group Nov 16 03:08:31.756874 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 16 03:08:31.757505 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service CORE assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.757828 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:subnetpool Nov 16 03:08:31.758192 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] subnetpool is already registered Nov 16 03:08:31.758645 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service CORE assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.758976 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:subnetpool Nov 16 03:08:31.759300 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] subnetpool is already registered Nov 16 03:08:31.761625 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.762045 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service FLAVORS assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.762625 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.763033 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.763357 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:router Nov 16 03:08:31.763688 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] router is already registered Nov 16 03:08:31.764085 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:floatingip Nov 16 03:08:31.764411 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] floatingip is already registered Nov 16 03:08:31.764853 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service METERING assigned prefix: /metering {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.765528 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of CountableResource for resource:rbac_policy Nov 16 03:08:31.765850 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] rbac_policy is already registered Nov 16 03:08:31.766252 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:security_group Nov 16 03:08:31.766578 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] security_group is already registered Nov 16 03:08:31.766970 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 16 03:08:31.767288 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] security_group_rule is already registered Nov 16 03:08:31.767902 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service CORE assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.768229 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:subnetpool Nov 16 03:08:31.768561 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] subnetpool is already registered Nov 16 03:08:31.768970 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.v2.resource_helper [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Service CORE assigned prefix: {{(pid=101791) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 16 03:08:31.769282 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Creating instance of TrackedResource for resource:subnetpool Nov 16 03:08:31.769633 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING neutron.quota.resource_registry [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] subnetpool is already registered Nov 16 03:08:31.770094 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: extensions {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.771595 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: address-groups {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.773099 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: address-scopes {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.774529 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: agents {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.775687 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: auto-allocated-topology {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.776904 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: availability_zones {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.778167 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: dhcp-networks {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.779687 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: dhcp-agents {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.781130 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: routers {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.783365 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: flavors {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.784566 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: service_profiles {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.786125 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: next_providers {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.787573 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: service_profiles {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.789091 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: floatingip-pools {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.790507 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: routers {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.792600 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: floatingips {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.793903 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: l3-routers {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.795296 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: l3-agents {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.796701 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: metering-labels {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.798080 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: metering-label-rules {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.799366 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: network-ip-availabilities {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.800616 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: bindings {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.802291 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: quotas {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.803833 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: quotas {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.805362 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: rbac-policies {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.806805 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: security-groups {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.808026 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: security-group-rules {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.809242 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: service-providers {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.810478 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: subnetpools {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.811868 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: subnetpools {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.813304 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.815042 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.817912 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.819633 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.821524 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.823314 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.824985 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.826876 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.828647 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.830489 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron.api.extensions [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Extended resource: tags {{(pid=101791) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 16 03:08:31.836630 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING keystonemiddleware.auth_token [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 03:08:31.841465 dv-cinder-818037-1-iscsi neutron-server[101791]: WARNING keystonemiddleware.auth_token [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 03:08:31.850275 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_concurrency.lockutils [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Acquired lock "singleton_lock" {{(pid=101791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 03:08:31.850742 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_concurrency.lockutils [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Releasing lock "singleton_lock" {{(pid=101791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 03:08:31.851387 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Starting 2 workers Nov 16 03:08:31.856361 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Started child 101898 {{(pid=101791) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 16 03:08:31.860921 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Started child 101899 {{(pid=101791) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 16 03:08:31.861575 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:31.862488 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO neutron.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 16 03:08:31.863007 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [-] (101898) wsgi starting up on http://0.0.0.0:9696 Nov 16 03:08:31.863217 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Publish callbacks [] for process, before_spawn {{(pid=101791) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:31.865403 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Starting 1 workers Nov 16 03:08:31.865999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:31.867347 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [-] (101899) wsgi starting up on http://0.0.0.0:9696 Nov 16 03:08:31.870829 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Started child 101900 {{(pid=101791) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 16 03:08:31.871350 dv-cinder-818037-1-iscsi neutron-server[101791]: INFO oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Starting 1 workers Nov 16 03:08:31.875278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] calling RpcWorker wait() {{(pid=101900) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 16 03:08:31.875278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] returning from RpcWorker wait() {{(pid=101900) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 16 03:08:31.876469 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:31.877066 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:08:31.877166 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Started child 101901 {{(pid=101791) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 16 03:08:31.877976 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG neutron_lib.callbacks.manager [None req-fe1d479f-1ff4-4875-aa11-534e3cb92c04 None None] Publish callbacks [] for process, after_spawn {{(pid=101791) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:31.879579 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101791) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 16 03:08:31.879779 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 03:08:31.880151 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 03:08:31.880360 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 03:08:31.880830 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 03:08:31.881162 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 03:08:31.881522 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:31.881992 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.881992 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.882228 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.882491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.882642 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:08:31.882784 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.883523 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.883889 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.884229 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.884515 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.884775 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.884942 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.885334 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.885609 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.885862 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.886170 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.886437 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.886699 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.886945 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.887132 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.887374 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.887640 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.887885 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.888164 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] debug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.888424 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.888919 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.889150 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.889388 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.889657 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.889931 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.890161 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.890415 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.890652 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.890868 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.891120 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.891383 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.891620 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.891856 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.892092 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.892307 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.892547 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.892782 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.893271 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] host = dv-cinder-818037-1-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.893522 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.893740 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.893967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.894210 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.894454 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.894674 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.894922 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.895171 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.895429 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.895668 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.895895 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.896146 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.896365 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.896622 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.896778 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_options = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.896989 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.897262 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.897570 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.897721 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.897860 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.898039 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.898306 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.898472 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.898727 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.898967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.899358 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.899638 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.899835 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.900005 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.900172 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.900400 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.900647 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.900855 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.901111 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.901362 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.901595 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.901898 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.902059 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.902278 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.902510 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.902741 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.902969 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.903200 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.903417 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.903632 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.903867 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.904124 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.904345 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.904587 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.904855 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.905077 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.905303 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.905596 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.905802 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.906029 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.906282 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.906522 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.906763 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.906995 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.907208 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.907437 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.907746 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_json = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.907980 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.908234 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.908476 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.908702 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.908929 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.909143 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.909546 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.909791 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.910618 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.911116 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.911527 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.911527 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.911767 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.911962 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.912245 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.912479 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.912764 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.913028 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.913367 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.913619 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.913903 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.914470 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.914470 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.915712 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.915712 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.915712 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.915712 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.915712 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.916051 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.916118 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.916391 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.917217 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.917217 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.917217 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.917471 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.917641 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.917917 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.918169 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.31/identity {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.918432 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.918663 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.918911 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.919353 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.919353 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.919575 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.919785 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.920220 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.920454 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.920679 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.920905 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.921156 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.921353 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.921749 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.921979 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.922223 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.922474 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.922722 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.922914 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.923127 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.923341 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.923553 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.923779 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.924009 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.924279 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.924515 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.924752 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.924988 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.925234 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.925477 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.926679 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.926679 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.926679 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.926679 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.926679 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.927041 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.927041 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.927204 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.927558 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.927793 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.928034 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.928283 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.928514 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.928732 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.928959 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.929175 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.929388 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.929641 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.929857 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.930069 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.930287 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.930596 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.930850 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.931066 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.931440 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.931660 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.931887 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.932102 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.932317 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.932657 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.932946 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.933162 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.933470 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.933688 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.933934 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.934135 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.934408 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.934626 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.934857 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.935084 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.935329 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.935658 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.935909 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.936114 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.936350 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.936729 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.936944 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.937181 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.937391 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.937662 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.938010 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.938285 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.938634 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.938799 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.939010 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.939254 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.939512 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.939877 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.940033 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.940417 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.940557 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.940784 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.941066 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.941338 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.941820 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.941820 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.942148 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.942283 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.942565 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.942817 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.943072 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.943303 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.943781 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.943781 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.944050 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.944235 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.944459 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.944755 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.944981 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.945192 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.945401 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.945704 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.945957 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.946230 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.946486 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.946732 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.946953 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.947285 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.947501 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.31/identity {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.947748 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.947987 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.948218 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.948431 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.948777 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.948935 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.949290 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.949452 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.949603 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.949807 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.950023 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.950265 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.950475 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.951050 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.951050 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.951320 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.951320 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.951600 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.951787 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.952008 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.952238 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.952433 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.952678 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.952880 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.953095 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.953355 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.953767 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.953926 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.954072 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.954326 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.954560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.954769 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.955012 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.955225 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.955431 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.955642 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.955855 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.956082 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.956310 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.956630 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.956844 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.957093 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.957340 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.957707 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.957945 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.958174 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.958404 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.958618 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.958950 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.959123 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.959300 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.959518 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.959728 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.959938 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.960169 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.960388 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.960623 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.960830 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.961287 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.961460 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.961771 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.961941 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.962246 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.962485 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.962819 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.963071 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.963290 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.963516 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.963742 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.963970 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.964196 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.964415 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.964629 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.964854 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.965078 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.965284 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.965523 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.966116 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.966116 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.966116 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.966537 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.966675 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.966850 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.967032 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.967196 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.967404 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.967657 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.967863 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.968075 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.968293 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.968506 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.968712 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.969049 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.969198 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.969333 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.969661 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.969802 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.969968 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.970265 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.970520 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.970882 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.971027 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.971282 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.971500 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.971720 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.972023 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.972335 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.972506 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.972713 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.972960 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.973141 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.973388 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.973709 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.973992 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.974248 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.974639 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.974781 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.975013 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:300:349'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.975451 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.975594 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.975769 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.976080 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.976345 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.976597 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.976818 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.977061 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.977357 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.977724 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.978048 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.978297 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.978557 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.978867 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.979181 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.979329 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.979533 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.979791 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.980003 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.980251 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.980479 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.980696 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.980910 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.981051 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 03:08:31.981608 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101791) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 16 03:08:31.981760 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 03:08:31.981911 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 03:08:31.982070 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 03:08:31.982238 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 03:08:31.982390 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 03:08:31.982597 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.982757 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.982918 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983161 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983300 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983439 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983570 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983696 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983829 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.983956 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.984106 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.984251 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.984397 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.984551 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.984764 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.984898 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985038 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985167 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985305 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985505 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985646 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985773 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.985898 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] debug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986038 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986210 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986377 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986505 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986658 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986813 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.986954 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.987108 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.987262 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.987401 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.987559 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.987714 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.987868 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988027 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988177 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988324 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988479 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988633 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988789 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] host = dv-cinder-818037-1-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.988934 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.989088 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.989236 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.989377 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.989569 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.989724 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.989881 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990034 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990186 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990459 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990615 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990755 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.990910 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.991065 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_options = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.991222 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.991376 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.991542 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.991699 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.991859 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.992015 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.992158 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.992313 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.992468 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.992623 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.992777 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.993177 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.993177 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.993408 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.993673 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.993744 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.993867 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994044 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994188 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994336 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994484 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994620 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994760 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.994896 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995186 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995482 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995622 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995836 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.995973 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996106 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996252 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996387 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996521 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996655 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996788 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.996919 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.997064 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.997387 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.997387 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.997764 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.997764 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998020 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998020 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998201 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998347 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_json = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998501 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998660 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998800 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.998945 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.999165 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.999347 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.999493 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.999629 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:08:31.999766 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:31.999908 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.000045 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.000190 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.000325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.000460 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.000628 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.000836 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.001011 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.001145 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.001310 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.001587 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.001821 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.002002 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.002138 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.002300 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.002559 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.002708 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.002870 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.003053 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.003190 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.003324 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.003500 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.003651 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.003878 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.004076 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.004216 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.004360 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.004540 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.004695 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.31/identity {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.004873 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.005053 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.005345 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.005571 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.005783 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.005949 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.006151 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.006296 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.006502 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.006649 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.006786 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.006920 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.007145 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.007342 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.007478 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.007631 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.007767 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.007940 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.008234 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.008386 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.008521 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.008521 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.008521 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.009330 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.009330 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.009330 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.009661 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.009726 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.009935 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010080 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010216 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010350 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010625 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010790 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.010925 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.011059 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.011246 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.011383 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.011566 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.011848 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012011 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012146 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012279 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012413 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012619 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012797 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.012947 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.013084 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.013248 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.013447 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.013644 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.013939 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.014052 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.014219 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.014578 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.014784 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.014949 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.015122 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.015333 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.015746 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.015746 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016129 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016129 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016470 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016552 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016710 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.016865 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.017640 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.017640 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.017640 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.017640 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.017905 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.017971 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.018172 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.018503 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.018880 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019027 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019174 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019437 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019576 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019692 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019977 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.019977 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.020635 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.020635 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.020635 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.020635 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.020970 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.021108 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.025491 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026072 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026151 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026264 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.026967 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.31/identity {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.027509 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028030 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028560 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028948 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028948 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.028948 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.029161 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.029161 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.029300 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.029489 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.029688 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.029891 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.030015 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.030190 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.030392 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.030598 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.030774 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.030892 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.031085 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.031243 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.031596 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.032015 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.032161 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.032340 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.032513 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.032675 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.032823 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.033032 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.033378 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.033507 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.033659 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.034032 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.034353 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.034697 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.034989 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.035669 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.035847 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.036189 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.036411 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.036577 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.036947 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.037313 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.037552 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.037691 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.037840 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038029 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.038325 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.040088 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.040088 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.040088 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.040088 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.040088 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.041288 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042136 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042136 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042136 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042136 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042582 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042582 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042582 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042902 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.042902 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043112 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043112 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043469 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043469 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043756 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043756 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.043939 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.044070 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.044433 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.044433 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.044759 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.044759 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.044956 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.045155 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.045317 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.045554 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.045836 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.045836 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.046155 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.046155 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.046312 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.046432 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.046592 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.046828 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.047011 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.047189 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.047372 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.047544 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:300:349'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.047773 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.047923 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.048076 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.048289 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.048498 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.048657 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.048846 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.049068 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.049258 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.049392 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.049670 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.049771 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.049936 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.050127 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.050272 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.050552 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.050691 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.050816 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.051178 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.051178 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.051370 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.051473 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.051659 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:08:32.051839 dv-cinder-818037-1-iscsi neutron-server[101791]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 03:08:32.195129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38596) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:08:32.203775 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [-] 10.222.0.31 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0063331 Nov 16 03:08:44.420711 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cae6d04-6d6a-4296-b6d6-71b8554246e8 None None] get_active_networks_info from dv-cinder-818037-1-iscsi {{(pid=101900) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 16 03:08:44.553407 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cae6d04-6d6a-4296-b6d6-71b8554246e8 None None] No non-hosted networks {{(pid=101900) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 16 03:08:44.558903 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ca0aa860-7584-4cd5-8fc0-c8cb7fac4d27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-565029'] for agent, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:48.419775 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-37116d8c-f9f1-4b85-9797-ae4fb9000ab1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-565029'] for agent, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:48.511289 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-790c064d-8867-4acd-b117-caf98d791498 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:49.760650 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-565029'] for agent, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:51.505861 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-565029'] for agent, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:51.579121 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-565029'] for agent, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:51.579776 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.580114 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.580491 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.582203 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.583514 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.586562 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.588134 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.589712 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.590070 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.590403 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.590752 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.591308 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:08:51.591553 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-818037-1-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:08:51.597256 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-818037-1-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:08:52.922714 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 38686) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:08:53.171103 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.db.l3_hamode_db [None req-a0ac8cf8-f014-41c6-90b8-07695fc24ed3 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 16 03:08:53.253100 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0ac8cf8-f014-41c6-90b8-07695fc24ed3 None None] Routers set() bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:08:53.253467 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0ac8cf8-f014-41c6-90b8-07695fc24ed3 None None] Router IDs set() for agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 16 03:08:53.505284 dv-cinder-818037-1-iscsi neutron-server[101899]: WARNING oslo_policy.policy [None req-7e6ca443-4d81-41fd-a475-89ced44459d8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:08:53.505890 dv-cinder-818037-1-iscsi neutron-server[101899]: WARNING oslo_policy.policy [None req-7e6ca443-4d81-41fd-a475-89ced44459d8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:08:53.741841 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [None req-7e6ca443-4d81-41fd-a475-89ced44459d8 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:08:53.743202 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7e6ca443-4d81-41fd-a475-89ced44459d8 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.8185639 Nov 16 03:08:56.299138 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38702) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:08:56.835248 dv-cinder-818037-1-iscsi neutron-server[101898]: WARNING oslo_policy.policy [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:08:56.835784 dv-cinder-818037-1-iscsi neutron-server[101898]: WARNING oslo_policy.policy [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:08:57.058422 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'shared': True, 'default_prefixlen': 26, 'is_default': True}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:08:57.152685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.policy [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101898) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 16 03:08:57.200022 dv-cinder-818037-1-iscsi neutron-server[101898]: WARNING oslo_policy.policy [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:08:57.200422 dv-cinder-818037-1-iscsi neutron-server[101898]: WARNING oslo_policy.policy [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:08:57.208902 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.quota [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] Loaded quota_driver: . Nov 16 03:08:57.300493 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789857401017', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789857402518', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789857389384', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789857384219', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789857377393', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789857166283', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3953036', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3946515', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-853412', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-933473'] for rbac-policy, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:57.381962 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:08:57.383314 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-115a0d4a-be49-4e10-876a-76c27c83932d admin admin] 10.222.0.31 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.0832176 Nov 16 03:09:00.149621 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38720) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:00.482219 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Request body: {'network': {'admin_state_up': True, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'name': 'private', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:09:00.514755 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Made reservation on behalf of b31d576dc1e4402ab7e6d6363dda4887 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:09:00.517741 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.536180 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.653971 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.660963 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.680886 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 348} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:09:00.709548 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8789858107585', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.710120 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Unsubscribe: segment precommit_create {{(pid=101898) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 16 03:09:00.710648 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Added segment 65e4375f-653c-4876-aa06-451153394216 of type vlan for network 724026aa-d02e-457e-8582-7701a7d04006 Nov 16 03:09:00.726251 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b903db8-9059-45ab-938e-e164b2707643,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:00.774146 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.774492 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.774823 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.775144 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.775460 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.775763 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.776075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.776400 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.776723 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.777040 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.777338 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.777672 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Tracked resource versions report: Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: pushed versions: Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: { 'AddressGroup': {'1.2'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'ConntrackHelper': {'1.0'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Log': {'1.0'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Network': {'1.1'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Port': {'1.7'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'PortForwarding': {'1.2'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'QosPolicy': {'1.10'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroup': {'1.5'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SubPort': {'1.0'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Subnet': {'1.1'}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Trunk': {'1.1'}} Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: consumer versions: Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'ConntrackHelper': '1.0', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Log': '1.0', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Network': '1.1', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Port': '1.7', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'PortForwarding': '1.2', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'QosPolicy': '1.10', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroup': '1.5', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroupRule': '1.2', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SubPort': '1.0', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Subnet': '1.1', Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Trunk': '1.1'}} Nov 16 03:09:00.778726 dv-cinder-818037-1-iscsi neutron-server[101898]: {{(pid=101898) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:09:00.833253 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.876085 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.877254 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:00.878112 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:00.956920 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8060830 Nov 16 03:09:00.983067 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a6090a-39e2-4fd7-8542-5d3510e7c54f admin admin] Pushing event updated for resources: {'Network': ['ID=724026aa-d02e-457e-8582-7701a7d04006,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:00.996430 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 724026aa-d02e-457e-8582-7701a7d04006 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:09:03.827394 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38734) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:04.284158 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11d768a6-397e-4d63-ba57-4cfe65bc1058 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:04.285856 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-11d768a6-397e-4d63-ba57-4cfe65bc1058 admin admin] 10.222.0.31 "GET /v2.0/networks/724026aa-d02e-457e-8582-7701a7d04006 HTTP/1.1" status: 200 len: 825 time: 0.4574730 Nov 16 03:09:04.316080 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-56322455-7516-4ff3-b196-7684137979c3 admin admin] 10.222.0.31 "GET /v2.0/subnetpools/a90e7656-7625-4a71-8166-9d9dadf50c9d HTTP/1.1" status: 200 len: 734 time: 0.0202219 Nov 16 03:09:04.326636 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Request body: {'subnet': {'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gateway_ip': '172.20.0.1', 'ip_version': 4, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'name': 'private-subnet', 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:09:04.352087 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Made reservation on behalf of b31d576dc1e4402ab7e6d6363dda4887 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:09:04.354592 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:04.666728 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:04.738941 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8da96c09-9587-4eaf-9768-cef76483a138,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:04.748965 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Checking segment: {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:09:04.749355 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Network hostable DHCP agents. Network: 724026aa-d02e-457e-8582-7701a7d04006, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:09:04.775383 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Network 724026aa-d02e-457e-8582-7701a7d04006 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:09:04.788866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 724026aa-d02e-457e-8582-7701a7d04006) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:09:04.794286 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:04.794877 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:04.800092 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b63babde-a1dc-48b6-ba97-efb6b9edc77d None None] Network 724026aa-d02e-457e-8582-7701a7d04006 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:09:04.813018 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e9fb004e-f0e1-43f9-b43c-4a155ab19587 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4899561 Nov 16 03:09:05.145244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-724026aa-d02e-457e-8582-7701a7d04006', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:09:05.146544 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:05.460330 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Allocated IP 172.20.0.2 (724026aa-d02e-457e-8582-7701a7d04006/8da96c09-9587-4eaf-9768-cef76483a138/d7741bdb-5740-4ebb-8dd2-8800fe5c740f) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:09:05.678035 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:05.687339 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:05.771971 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Network 724026aa-d02e-457e-8582-7701a7d04006 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:09:05.777663 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:09:05.791302 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:09:05.794589 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Pushing event updated for resources: {'Port': ['ID=d7741bdb-5740-4ebb-8dd2-8800fe5c740f,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:05.833987 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.834570 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.834648 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.834958 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.835286 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.835617 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.836056 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.837004 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.837365 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.837720 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.838052 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.838376 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Tracked resource versions report: Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: pushed versions: Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: { 'AddressGroup': {'1.2'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'ConntrackHelper': {'1.0'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Log': {'1.0'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Network': {'1.1'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Port': {'1.7'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'PortForwarding': {'1.2'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'QosPolicy': {'1.10'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroup': {'1.5'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SubPort': {'1.0'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Subnet': {'1.1'}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Trunk': {'1.1'}} Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: consumer versions: Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'ConntrackHelper': '1.0', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Log': '1.0', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Network': '1.1', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Port': '1.7', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'PortForwarding': '1.2', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'QosPolicy': '1.10', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroup': '1.5', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroupRule': '1.2', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SubPort': '1.0', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Subnet': '1.1', Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Trunk': '1.1'}} Nov 16 03:09:05.839542 dv-cinder-818037-1-iscsi neutron-server[101900]: {{(pid=101900) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:09:05.891847 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Attempting to bind port d7741bdb-5740-4ebb-8dd2-8800fe5c740f on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:09:05.892248 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Attempting to bind port d7741bdb-5740-4ebb-8dd2-8800fe5c740f by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:09:05.892657 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Attempting to bind port d7741bdb-5740-4ebb-8dd2-8800fe5c740f on network 724026aa-d02e-457e-8582-7701a7d04006 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:09:05.898279 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 8, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:09:05.898685 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Checking segment: {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:09:05.899815 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:05.900207 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Bound using segment: {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:09:05.900694 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Bound port: d7741bdb-5740-4ebb-8dd2-8800fe5c740f, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:09:05.901092 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:05.967635 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] For port d7741bdb-5740-4ebb-8dd2-8800fe5c740f, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:09:05.972246 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] For port d7741bdb-5740-4ebb-8dd2-8800fe5c740f, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=d7741bdb-5740-4ebb-8dd2-8800fe5c740f,segment=NetworkSegment(65e4375f-653c-4876-aa06-451153394216),segment_id=65e4375f-653c-4876-aa06-451153394216)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:09:05.978051 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:06.049832 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc6640f-6443-4458-860e-ac8525fdc49b None None] Pushing event updated for resources: {'Port': ['ID=d7741bdb-5740-4ebb-8dd2-8800fe5c740f,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:07.455971 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 38742) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:07.831679 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [None req-7b44757c-1521-4fbb-9695-a99646556395 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:09:07.832701 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7b44757c-1521-4fbb-9695-a99646556395 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3760729 Nov 16 03:09:10.455330 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 38750) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:10.819746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [None req-e785ec80-799a-48ec-8567-30e7fb782c4d admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:09:10.821132 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-e785ec80-799a-48ec-8567-30e7fb782c4d admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3648775 Nov 16 03:09:13.775196 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38760) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:14.116123 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'name': 'router1'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:09:14.161371 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:14.169300 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:14.319280 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:14.326289 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:14.345287 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:14.346595 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f6288f4f-6a8d-40db-8b78-4391b3545aa7 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5703247 Nov 16 03:09:14.348185 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4c7de182-326f-48c7-9a4a-a4c4dfdcd57d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:15.361387 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19f1cfb0-935f-414a-a9bf-01551feafb12 None None] Network 724026aa-d02e-457e-8582-7701a7d04006 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:09:15.464715 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-cfc7733b-3df3-469d-b834-1ff562289f55 None None] Provisioning complete for port d7741bdb-5740-4ebb-8dd2-8800fe5c740f triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:15.465112 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-cfc7733b-3df3-469d-b834-1ff562289f55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:15.546873 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device d7741bdb-5740-4ebb-8dd2-8800fe5c740f up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:09:15.724789 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port d7741bdb-5740-4ebb-8dd2-8800fe5c740f triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:15.725153 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:15.750073 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-cfc7733b-3df3-469d-b834-1ff562289f55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:15.801067 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-cfc7733b-3df3-469d-b834-1ff562289f55 None None] For port d7741bdb-5740-4ebb-8dd2-8800fe5c740f, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=d7741bdb-5740-4ebb-8dd2-8800fe5c740f,segment=NetworkSegment(65e4375f-653c-4876-aa06-451153394216),segment_id=65e4375f-653c-4876-aa06-451153394216)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:09:15.831874 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-cfc7733b-3df3-469d-b834-1ff562289f55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:15.864291 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:15.900024 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc7733b-3df3-469d-b834-1ff562289f55 None None] Pushing event updated for resources: {'Port': ['ID=d7741bdb-5740-4ebb-8dd2-8800fe5c740f,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:15.937515 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.db.api [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=101900) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 16 03:09:15.937935 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG oslo_db.api [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 16 03:09:15.950972 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-4d2c7f10-f5fb-46e7-8387-bef09b59e8e7 None None] Provisioning complete for port d7741bdb-5740-4ebb-8dd2-8800fe5c740f triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:15.951247 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4d2c7f10-f5fb-46e7-8387-bef09b59e8e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:16.952129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38774) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:17.311629 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [None req-f2645517-23db-4a70-b47b-924f3b0991f6 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101898) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:09:17.312643 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f2645517-23db-4a70-b47b-924f3b0991f6 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3595142 Nov 16 03:09:17.508398 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device d7741bdb-5740-4ebb-8dd2-8800fe5c740f up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:09:17.565091 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port d7741bdb-5740-4ebb-8dd2-8800fe5c740f triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:17.565456 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:18.412355 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-9cf8a3e8-7221-431f-96cf-12061045a6e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:19.738710 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:19.935548 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38792) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:20.093576 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Request body: {'network': {'router:external': True, 'provider:network_type': 'flat', 'admin_state_up': True, 'provider:physical_network': 'physnet1', 'name': 'public', 'is_default': True}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:09:20.116200 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Made reservation on behalf of fb897d934c0d40faa98082f63fe4c388 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:09:20.118736 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.127016 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.214599 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.220070 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.238234 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Reserving flat network on physical network physnet1 {{(pid=101898) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 16 03:09:20.255047 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c179b6ba-6c49-4c0e-a78c-fe7f41c8798a,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:20.260724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.261067 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Added segment adc7bcd9-ce4d-4ced-baf2-487066118c1f of type flat for network 0589aea0-39a1-4e64-bdfc-1695da7bfecf Nov 16 03:09:20.318672 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.352859 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.353952 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:20.354522 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:20.412928 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4762802 Nov 16 03:09:20.425223 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6cac5e4-1585-4d55-86bf-8aa12096e161 admin admin] Pushing event updated for resources: {'Network': ['ID=0589aea0-39a1-4e64-bdfc-1695da7bfecf,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:20.439153 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:09:21.402293 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:21.577112 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:22.853741 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 38810) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:23.120885 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.policy [None req-effe8d85-2cb5-4e2e-a7bb-d9f8da5604f2 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101899) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 16 03:09:23.171161 dv-cinder-818037-1-iscsi neutron-server[101899]: WARNING oslo_policy.policy [None req-effe8d85-2cb5-4e2e-a7bb-d9f8da5604f2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:09:23.171539 dv-cinder-818037-1-iscsi neutron-server[101899]: WARNING oslo_policy.policy [None req-effe8d85-2cb5-4e2e-a7bb-d9f8da5604f2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 16 03:09:23.180119 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-effe8d85-2cb5-4e2e-a7bb-d9f8da5604f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:23.182100 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-effe8d85-2cb5-4e2e-a7bb-d9f8da5604f2 admin admin] 10.222.0.31 "GET /v2.0/subnets/8da96c09-9587-4eaf-9768-cef76483a138 HTTP/1.1" status: 200 len: 849 time: 0.3273737 Nov 16 03:09:23.357327 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-646a116a-62a6-4419-b3cc-0f1eeb3e7ef4 admin admin] 10.222.0.31 "GET /v2.0/routers/197d21d1-8537-41d0-b50c-75a4e40c4131 HTTP/1.1" status: 200 len: 704 time: 0.1689007 Nov 16 03:09:23.642323 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.005694 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Allocated IP 172.20.0.1 (724026aa-d02e-457e-8582-7701a7d04006/8da96c09-9587-4eaf-9768-cef76483a138/00f6cea8-117e-44c1-8616-cf7ccb7194b4) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:09:24.229978 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.298322 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.360657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Network 724026aa-d02e-457e-8582-7701a7d04006 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:09:24.365364 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:09:24.419246 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:09:24.420427 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.439118 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Pushing event updated for resources: {'Port': ['ID=00f6cea8-117e-44c1-8616-cf7ccb7194b4,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:24.515278 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.515647 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.516028 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.516362 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.516687 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.517026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.517383 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.517729 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.518079 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.518404 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.518687 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.519000 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Tracked resource versions report: Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: pushed versions: Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: { 'AddressGroup': {'1.2'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'ConntrackHelper': {'1.0'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Log': {'1.0'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Network': {'1.1'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Port': {'1.7'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'PortForwarding': {'1.2'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'QosPolicy': {'1.10'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroup': {'1.5'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SubPort': {'1.0'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Subnet': {'1.1'}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Trunk': {'1.1'}} Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: consumer versions: Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'ConntrackHelper': '1.0', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Log': '1.0', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Network': '1.1', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Port': '1.7', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'PortForwarding': '1.2', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'QosPolicy': '1.10', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroup': '1.5', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroupRule': '1.2', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SubPort': '1.0', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Subnet': '1.1', Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Trunk': '1.1'}} Nov 16 03:09:24.520097 dv-cinder-818037-1-iscsi neutron-server[101899]: {{(pid=101899) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:09:24.610772 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8b78780c-8db2-49c6-b6be-87334743642d None None] Provisioning complete for port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:24.611423 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8b78780c-8db2-49c6-b6be-87334743642d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.643121 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.647360 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8b78780c-8db2-49c6-b6be-87334743642d None None] Port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:09:24.876660 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.882185 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.883032 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:24.972617 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Pushing event updated for resources: {'Port': ['ID=00f6cea8-117e-44c1-8616-cf7ccb7194b4,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:25.034796 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Network 724026aa-d02e-457e-8582-7701a7d04006 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:09:25.036845 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:09:25.275907 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8704fe59-d3c6-408d-9079-42dd6866aeda None None] Provisioning complete for port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:25.276283 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8704fe59-d3c6-408d-9079-42dd6866aeda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:25.301384 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Router 197d21d1-8537-41d0-b50c-75a4e40c4131 is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101899) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:09:25.325755 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8704fe59-d3c6-408d-9079-42dd6866aeda None None] Port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:09:25.403537 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:09:25.409205 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d84ff306-8f49-4053-b813-22c52a12242a admin admin] 10.222.0.31 "PUT /v2.0/routers/197d21d1-8537-41d0-b50c-75a4e40c4131/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0455043 Nov 16 03:09:25.425312 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Sync routers for ids ['197d21d1-8537-41d0-b50c-75a4e40c4131'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:09:25.440414 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Routers {'197d21d1-8537-41d0-b50c-75a4e40c4131'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:09:25.441270 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:09:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['197d21d1-8537-41d0-b50c-75a4e40c4131'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:25.636735 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Set router 197d21d1-8537-41d0-b50c-75a4e40c4131 gateway port host: None {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:09:26.095474 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'name': 'router1', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:09:14Z', 'updated_at': '2021-11-16T03:09:24Z', 'revision_number': 2, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gw_port_host': None, '_interfaces': [{'id': '00f6cea8-117e-44c1-8616-cf7ccb7194b4', 'name': '', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'mac_address': 'fa:16:3e:18:ee:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:23Z', 'updated_at': '2021-11-16T03:09:24Z', 'revision_number': 2, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'subnets': [{'id': '8da96c09-9587-4eaf-9768-cef76483a138', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:26.148726 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Checking router: 197d21d1-8537-41d0-b50c-75a4e40c4131 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:09:26.149047 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Updating router 197d21d1-8537-41d0-b50c-75a4e40c4131 port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:09:26.200975 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:26.738332 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:26.747836 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:26.911298 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Pushing event updated for resources: {'Port': ['ID=00f6cea8-117e-44c1-8616-cf7ccb7194b4,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:26.928494 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.928856 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.929296 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.929718 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.930341 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.930341 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.930724 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.931051 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.931377 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.931700 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.932021 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.932340 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Tracked resource versions report: Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: pushed versions: Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: { 'AddressGroup': {'1.2'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'ConntrackHelper': {'1.0'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Log': {'1.0'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Network': {'1.1'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Port': {'1.7'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'PortForwarding': {'1.2'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'QosPolicy': {'1.10'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroup': {'1.5'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SubPort': {'1.0'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Subnet': {'1.1'}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Trunk': {'1.1'}} Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: consumer versions: Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'ConntrackHelper': '1.0', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Log': '1.0', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Network': '1.1', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Port': '1.7', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'PortForwarding': '1.2', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'QosPolicy': '1.10', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroup': '1.5', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroupRule': '1.2', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SubPort': '1.0', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Subnet': '1.1', Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Trunk': '1.1'}} Nov 16 03:09:26.933470 dv-cinder-818037-1-iscsi neutron-server[101901]: {{(pid=101901) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:09:26.938519 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Attempting to bind port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:09:26.938937 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Attempting to bind port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:09:26.939481 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Attempting to bind port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 on network 724026aa-d02e-457e-8582-7701a7d04006 {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:09:26.945413 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 9, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:09:26.945413 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Checking segment: {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:09:26.946392 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:26.946780 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Bound using segment: {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:09:26.947368 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Bound port: 00f6cea8-117e-44c1-8616-cf7ccb7194b4, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65e4375f-653c-4876-aa06-451153394216', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 348, 'network_id': '724026aa-d02e-457e-8582-7701a7d04006'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:09:26.947920 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:27.020888 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] For port 00f6cea8-117e-44c1-8616-cf7ccb7194b4, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:09:27.043667 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] For port 00f6cea8-117e-44c1-8616-cf7ccb7194b4, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=00f6cea8-117e-44c1-8616-cf7ccb7194b4,segment=NetworkSegment(65e4375f-653c-4876-aa06-451153394216),segment_id=65e4375f-653c-4876-aa06-451153394216)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:09:27.049420 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:27.063193 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-0fe2fdf5-6bf4-4a13-a496-37b2bb5f2150 None None] Provisioning complete for port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:27.063830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0fe2fdf5-6bf4-4a13-a496-37b2bb5f2150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:27.098359 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Routers {'197d21d1-8537-41d0-b50c-75a4e40c4131'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:09:27.098991 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:09:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['197d21d1-8537-41d0-b50c-75a4e40c4131'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:27.162282 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0fe2fdf5-6bf4-4a13-a496-37b2bb5f2150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:27.189881 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] Set router 197d21d1-8537-41d0-b50c-75a4e40c4131 gateway port host: None {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:09:27.199284 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-0fe2fdf5-6bf4-4a13-a496-37b2bb5f2150 None None] For port 00f6cea8-117e-44c1-8616-cf7ccb7194b4, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=00f6cea8-117e-44c1-8616-cf7ccb7194b4,segment=NetworkSegment(65e4375f-653c-4876-aa06-451153394216),segment_id=65e4375f-653c-4876-aa06-451153394216)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:09:27.204727 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0fe2fdf5-6bf4-4a13-a496-37b2bb5f2150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:27.268807 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe2fdf5-6bf4-4a13-a496-37b2bb5f2150 None None] Pushing event updated for resources: {'Port': ['ID=00f6cea8-117e-44c1-8616-cf7ccb7194b4,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:27.324884 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e733e752-fac1-46d9-b7a4-4f400936bf44 None None] Pushing event updated for resources: {'Port': ['ID=00f6cea8-117e-44c1-8616-cf7ccb7194b4,revision_number=4']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:27.327651 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-0c752a53-ab69-4aa9-b316-2f1dad362227 None None] Provisioning complete for port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:27.328197 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0c752a53-ab69-4aa9-b316-2f1dad362227 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:27.442143 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'name': 'router1', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:09:14Z', 'updated_at': '2021-11-16T03:09:24Z', 'revision_number': 2, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gw_port_host': None, '_interfaces': [{'id': '00f6cea8-117e-44c1-8616-cf7ccb7194b4', 'name': '', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'mac_address': 'fa:16:3e:18:ee:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:23Z', 'updated_at': '2021-11-16T03:09:27Z', 'revision_number': 4, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'subnets': [{'id': '8da96c09-9587-4eaf-9768-cef76483a138', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:27.469259 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb9e078-ad39-43eb-bc3d-b45df0ff108c None None] The sync data for ids ['197d21d1-8537-41d0-b50c-75a4e40c4131'] in dv-cinder-818037-1-iscsi is: [{'id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'name': 'router1', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:09:14Z', 'updated_at': '2021-11-16T03:09:24Z', 'revision_number': 2, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gw_port_host': None, '_interfaces': [{'id': '00f6cea8-117e-44c1-8616-cf7ccb7194b4', 'name': '', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'mac_address': 'fa:16:3e:18:ee:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:23Z', 'updated_at': '2021-11-16T03:09:27Z', 'revision_number': 4, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'subnets': [{'id': '8da96c09-9587-4eaf-9768-cef76483a138', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:09:27.849736 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38826) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:27.979685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06808816-f20d-4566-861b-f51682d86925 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:27.981062 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-06808816-f20d-4566-861b-f51682d86925 admin admin] 10.222.0.31 "GET /v2.0/networks/0589aea0-39a1-4e64-bdfc-1695da7bfecf HTTP/1.1" status: 200 len: 842 time: 0.1303377 Nov 16 03:09:27.991997 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Request body: {'subnet': {'enable_dhcp': False, 'ip_version': 4, 'gateway_ip': '172.27.1.1', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'cidr': '172.27.1.0/24', 'name': 'public-subnet'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:09:28.024421 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Made reservation on behalf of fb897d934c0d40faa98082f63fe4c388 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:09:28.026907 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:28.369929 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.objects.ports [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=101898) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 16 03:09:28.370215 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:28.433510 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Pushing event updated for resources: {'Subnet': ['ID=def32ff7-e3b0-42ad-b7c9-bfe553479a1b,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:28.445891 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:09:28.446211 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Network hostable DHCP agents. Network: 0589aea0-39a1-4e64-bdfc-1695da7bfecf, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:09:28.471213 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:09:28.482555 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 0589aea0-39a1-4e64-bdfc-1695da7bfecf) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:09:28.487033 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:28.487625 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:28.493092 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c56c3b4-327d-4509-9015-b11f4ca7a5ce None None] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:09:28.506372 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-67f8af5c-0e99-44c8-a0d8-cf808daf252c admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5182340 Nov 16 03:09:28.652418 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80961124-6d17-433d-b2c8-c1f48fddb941 None None] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:09:31.009520 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38834) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:31.239505 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b0239798-0384-4917-b5db-59215e5f4a47 admin admin] 10.222.0.31 "GET /v2.0/routers/197d21d1-8537-41d0-b50c-75a4e40c4131 HTTP/1.1" status: 200 len: 710 time: 0.2287064 Nov 16 03:09:31.346314 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69c10602-7999-419c-bc5f-dbc0801097ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:09:31.347728 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-69c10602-7999-419c-bc5f-dbc0801097ce admin admin] 10.222.0.31 "GET /v2.0/networks/0589aea0-39a1-4e64-bdfc-1695da7bfecf HTTP/1.1" status: 200 len: 886 time: 0.1017337 Nov 16 03:09:31.358218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:09:31.665920 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:31.921028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:32.010247 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:32.183061 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Allocated IP 172.27.1.205 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/036499c5-8f2d-461c-99d0-2df018d67ac0) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:09:32.313159 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:32.378353 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:32.454535 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:09:32.462804 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:09:32.469765 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:09:32.543041 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Pushing event updated for resources: {'Port': ['ID=036499c5-8f2d-461c-99d0-2df018d67ac0,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:32.828094 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:33.191853 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-557363', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-564668', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-748'] for router, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:33.200912 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-557356', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-557349', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-564661'] for router, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:33.343836 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Router 197d21d1-8537-41d0-b50c-75a4e40c4131 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:09:33.485023 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:09:33.494518 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:33.497333 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7c4b7c76-33c0-47b5-80fb-283693309f81 admin admin] 10.222.0.31 "PUT /v2.0/routers/197d21d1-8537-41d0-b50c-75a4e40c4131 HTTP/1.1" status: 200 len: 890 time: 2.1425385 Nov 16 03:09:33.561240 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 00f6cea8-117e-44c1-8616-cf7ccb7194b4 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:09:33.621901 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:33.622361 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:34.890130 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Sync routers for ids ['197d21d1-8537-41d0-b50c-75a4e40c4131'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:09:34.904105 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Routers {'197d21d1-8537-41d0-b50c-75a4e40c4131'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:09:34.904760 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:09:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['197d21d1-8537-41d0-b50c-75a4e40c4131'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:35.129033 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Set router 197d21d1-8537-41d0-b50c-75a4e40c4131 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:09:35.647543 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'name': 'router1', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.205'}], 'enable_snat': True}, 'gw_port_id': '036499c5-8f2d-461c-99d0-2df018d67ac0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:09:14Z', 'updated_at': '2021-11-16T03:09:32Z', 'revision_number': 4, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gw_port': {'id': '036499c5-8f2d-461c-99d0-2df018d67ac0', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:05:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:32Z', 'updated_at': '2021-11-16T03:09:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '00f6cea8-117e-44c1-8616-cf7ccb7194b4', 'name': '', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'mac_address': 'fa:16:3e:18:ee:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:23Z', 'updated_at': '2021-11-16T03:09:27Z', 'revision_number': 5, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'subnets': [{'id': '8da96c09-9587-4eaf-9768-cef76483a138', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:35.700222 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Checking router: 197d21d1-8537-41d0-b50c-75a4e40c4131 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:09:35.700390 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Updating router 197d21d1-8537-41d0-b50c-75a4e40c4131 port 036499c5-8f2d-461c-99d0-2df018d67ac0 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:09:35.749205 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:36.149338 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:36.156522 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:36.217933 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Attempting to bind port 036499c5-8f2d-461c-99d0-2df018d67ac0 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:09:36.218350 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Attempting to bind port 036499c5-8f2d-461c-99d0-2df018d67ac0 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:09:36.218681 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Attempting to bind port 036499c5-8f2d-461c-99d0-2df018d67ac0 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:09:36.220801 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f2bbca-8314-4476-aa25-c368420084e0 None None] Pushing event updated for resources: {'Port': ['ID=036499c5-8f2d-461c-99d0-2df018d67ac0,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:36.228340 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 9, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:09:36.229806 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:09:36.229806 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:36.229806 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:09:36.230258 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Bound port: 036499c5-8f2d-461c-99d0-2df018d67ac0, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:09:36.230415 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:36.295644 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] For port 036499c5-8f2d-461c-99d0-2df018d67ac0, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:09:36.301312 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] For port 036499c5-8f2d-461c-99d0-2df018d67ac0, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=036499c5-8f2d-461c-99d0-2df018d67ac0,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:09:36.308074 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:36.324643 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 38846) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:09:36.394623 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Routers {'197d21d1-8537-41d0-b50c-75a4e40c4131'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:09:36.395260 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:09:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['197d21d1-8537-41d0-b50c-75a4e40c4131'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:36.402734 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f2bbca-8314-4476-aa25-c368420084e0 None None] Pushing event updated for resources: {'Port': ['ID=036499c5-8f2d-461c-99d0-2df018d67ac0,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:36.490672 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b782987e-e845-4d08-b678-adf3262e658a admin admin] 10.222.0.31 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1627493 Nov 16 03:09:36.547908 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] Set router 197d21d1-8537-41d0-b50c-75a4e40c4131 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:09:36.850395 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'name': 'router1', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.205'}], 'enable_snat': True}, 'gw_port_id': '036499c5-8f2d-461c-99d0-2df018d67ac0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:09:14Z', 'updated_at': '2021-11-16T03:09:32Z', 'revision_number': 4, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gw_port': {'id': '036499c5-8f2d-461c-99d0-2df018d67ac0', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:05:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:32Z', 'updated_at': '2021-11-16T03:09:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '00f6cea8-117e-44c1-8616-cf7ccb7194b4', 'name': '', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'mac_address': 'fa:16:3e:18:ee:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:23Z', 'updated_at': '2021-11-16T03:09:27Z', 'revision_number': 5, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'subnets': [{'id': '8da96c09-9587-4eaf-9768-cef76483a138', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:09:36.879851 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c9f956c-6166-4b0e-a4da-c71e71f83d4c None None] The sync data for ids ['197d21d1-8537-41d0-b50c-75a4e40c4131'] in dv-cinder-818037-1-iscsi is: [{'id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'name': 'router1', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.205'}], 'enable_snat': True}, 'gw_port_id': '036499c5-8f2d-461c-99d0-2df018d67ac0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:09:14Z', 'updated_at': '2021-11-16T03:09:32Z', 'revision_number': 4, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'gw_port': {'id': '036499c5-8f2d-461c-99d0-2df018d67ac0', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:05:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.205', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:32Z', 'updated_at': '2021-11-16T03:09:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '00f6cea8-117e-44c1-8616-cf7ccb7194b4', 'name': '', 'network_id': '724026aa-d02e-457e-8582-7701a7d04006', 'tenant_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'mac_address': 'fa:16:3e:18:ee:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '197d21d1-8537-41d0-b50c-75a4e40c4131', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8da96c09-9587-4eaf-9768-cef76483a138', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:09:23Z', 'updated_at': '2021-11-16T03:09:27Z', 'revision_number': 5, 'project_id': 'b31d576dc1e4402ab7e6d6363dda4887', 'subnets': [{'id': '8da96c09-9587-4eaf-9768-cef76483a138', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'a90e7656-7625-4a71-8166-9d9dadf50c9d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:09:37.609321 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 036499c5-8f2d-461c-99d0-2df018d67ac0 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:09:37.725687 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 036499c5-8f2d-461c-99d0-2df018d67ac0 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:37.726965 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:37.833245 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:37.857112 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 036499c5-8f2d-461c-99d0-2df018d67ac0, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=036499c5-8f2d-461c-99d0-2df018d67ac0,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:09:37.861984 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:37.929086 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=036499c5-8f2d-461c-99d0-2df018d67ac0,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:09:38.950761 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:09:39.534695 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 036499c5-8f2d-461c-99d0-2df018d67ac0 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:09:39.613408 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 036499c5-8f2d-461c-99d0-2df018d67ac0 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:09:39.613831 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:44.399157 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-f2f0f460-3fb0-4e81-816e-ed908ef32ae0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:48.417474 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b70f1ddf-a9f0-40fc-907b-e182310a1f69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:49.704474 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:51.407845 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:09:51.581253 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:14.364328 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-f7371180-e26d-4648-9e42-265ac147074a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:15.956493 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:10:18.423331 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4979e08a-be7e-4581-9a65-78aa65b61b80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:19.700137 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:21.417720 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:21.587838 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:44.358627 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-37855754-6fc6-4932-8455-e684eec99e04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:48.419507 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-52f91fae-d631-4a45-907d-11c864d0d690 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:49.693411 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:51.419595 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:51.574382 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:10:52.956994 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:11:14.361882 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-32e95270-2d85-449f-a2e6-3c10fc81da24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:18.425343 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4656525a-b395-4d6e-9f94-340f0a746856 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:19.696562 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:21.422342 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:21.571263 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:22.339409 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39408) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:22.405945 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b0fbef8-1904-41b5-9a59-5acb18362803 admin admin] GET failed (client error): The resource could not be found. Nov 16 03:11:22.407293 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1b0fbef8-1904-41b5-9a59-5acb18362803 admin admin] 10.222.0.31 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0666084 Nov 16 03:11:22.581588 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd6a4e0b-7db6-4a22-a9aa-fb450021687e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:22.583108 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-fd6a4e0b-7db6-4a22-a9aa-fb450021687e admin admin] 10.222.0.31 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1703913 Nov 16 03:11:24.920138 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39418) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:25.021344 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fa9934f-2144-4a0f-8af9-3b7bad35eb19 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:25.022950 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-0fa9934f-2144-4a0f-8af9-3b7bad35eb19 admin admin] 10.222.0.31 "GET /v2.0/subnets/8da96c09-9587-4eaf-9768-cef76483a138 HTTP/1.1" status: 200 len: 849 time: 0.1017835 Nov 16 03:11:25.033403 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:11:25.123601 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Publish callbacks [] for subnet, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:25.269047 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8789858118822'] for subnet, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:25.304403 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:25.304535 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:25.305892 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] 10.222.0.31 "PUT /v2.0/subnets/8da96c09-9587-4eaf-9768-cef76483a138 HTTP/1.1" status: 200 len: 868 time: 0.2763798 Nov 16 03:11:25.308190 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3df3d890-38c5-4dd7-8881-134a7d0aeb4c None None] Network 724026aa-d02e-457e-8582-7701a7d04006 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:11:25.328178 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8da96c09-9587-4eaf-9768-cef76483a138,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:11:25.336908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.337281 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.337654 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.337978 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.338317 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.338670 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.339155 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.339477 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.339827 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.340145 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.340451 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.340782 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e990ab6-8ae5-4d7d-8a9b-37537862fc03 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:11:25.733030 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-7ac2f20a-52d7-4976-92ab-47898b883913 None None] Provisioning complete for port d7741bdb-5740-4ebb-8dd2-8800fe5c740f triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:11:25.733397 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7ac2f20a-52d7-4976-92ab-47898b883913 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:25.826976 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-7ac2f20a-52d7-4976-92ab-47898b883913 None None] Provisioning complete for port 00f6cea8-117e-44c1-8616-cf7ccb7194b4 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:11:25.827608 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7ac2f20a-52d7-4976-92ab-47898b883913 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:27.639486 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39426) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:27.848048 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1a60488-d4ad-4766-aef1-072b0a243c82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:27.849063 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1a60488-d4ad-4766-aef1-072b0a243c82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:27.850524 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d1a60488-d4ad-4766-aef1-072b0a243c82 admin admin] 10.222.0.31 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2100096 Nov 16 03:11:29.955933 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:11:30.245344 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39436) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:30.453728 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2be7437e-8460-419b-b53a-6df027bdb178 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:30.454085 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2be7437e-8460-419b-b53a-6df027bdb178 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:30.455651 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2be7437e-8460-419b-b53a-6df027bdb178 admin admin] 10.222.0.31 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2093446 Nov 16 03:11:32.813905 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39444) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:32.948140 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69b7ac09-0586-4605-a4fe-c9aafedcbb80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:32.949612 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-69b7ac09-0586-4605-a4fe-c9aafedcbb80 admin admin] 10.222.0.31 "GET /v2.0/networks/0589aea0-39a1-4e64-bdfc-1695da7bfecf HTTP/1.1" status: 200 len: 886 time: 0.1346753 Nov 16 03:11:35.317048 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39452) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:35.481570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc950565-8016-468b-9cea-e44cb703fd9c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:35.482964 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-dc950565-8016-468b-9cea-e44cb703fd9c admin admin] 10.222.0.31 "GET /v2.0/networks/724026aa-d02e-457e-8582-7701a7d04006 HTTP/1.1" status: 200 len: 869 time: 0.1649096 Nov 16 03:11:38.048868 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39460) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:38.183355 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dce3f538-107b-4be2-9d8c-18ef434153d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:38.183792 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dce3f538-107b-4be2-9d8c-18ef434153d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:38.185342 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-dce3f538-107b-4be2-9d8c-18ef434153d1 admin admin] 10.222.0.31 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1355772 Nov 16 03:11:40.548367 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39468) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:40.685448 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44603177-b4b1-4a14-be8a-4c8ded228a9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:40.685942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44603177-b4b1-4a14-be8a-4c8ded228a9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:40.687482 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-44603177-b4b1-4a14-be8a-4c8ded228a9e admin admin] 10.222.0.31 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1381698 Nov 16 03:11:43.066264 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39476) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:43.163432 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f2e83b2-c716-4d18-9ebb-0cc17d9c74b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:43.164796 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-9f2e83b2-c716-4d18-9ebb-0cc17d9c74b1 admin admin] 10.222.0.31 "GET /v2.0/subnets/8da96c09-9587-4eaf-9768-cef76483a138 HTTP/1.1" status: 200 len: 868 time: 0.0972509 Nov 16 03:11:44.367941 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8916d0a9-a514-43b3-bd6f-ee003b333875 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:45.541062 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39484) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:11:45.631972 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-083dcc7b-32de-42e8-bbfa-882982189135 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:11:45.633338 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-083dcc7b-32de-42e8-bbfa-882982189135 admin admin] 10.222.0.31 "GET /v2.0/subnets/def32ff7-e3b0-42ad-b7c9-bfe553479a1b HTTP/1.1" status: 200 len: 816 time: 0.0912743 Nov 16 03:11:48.422016 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7edfc4f7-9a91-4efa-a424-ffcddd714da3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:49.707624 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:51.425553 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:11:51.569698 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:06.954610 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:12:10.445005 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39538) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:12:10.497675 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [None req-7dfa86d1-c015-4026-ba00-d009e945c8e8 admin admin] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101898) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:12:10.498677 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7dfa86d1-c015-4026-ba00-d009e945c8e8 admin admin] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0527081 Nov 16 03:12:12.969699 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39546) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:12:13.041920 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.pecan_wsgi.hooks.translation [None req-8911c4cf-72c8-48a5-8c1b-6246554fba83 admin admin] GET failed (client error): The resource could not be found. Nov 16 03:12:13.043360 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8911c4cf-72c8-48a5-8c1b-6246554fba83 admin admin] 10.222.0.31 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0726011 Nov 16 03:12:13.214189 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7abb9a1a-a7dd-41da-b307-20951979b906 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:12:13.215621 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7abb9a1a-a7dd-41da-b307-20951979b906 admin admin] 10.222.0.31 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1657350 Nov 16 03:12:14.368087 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-de79b2db-c6f1-4ff0-9565-86c5b45b8593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:15.626595 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39554) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:12:15.684021 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:12:15.707697 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Made reservation on behalf of fb897d934c0d40faa98082f63fe4c388 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:12:15.710025 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:15.848313 dv-cinder-818037-1-iscsi neutron-server[101898]: WARNING neutron.services.revisions.revision_plugin [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Could not find related network for resource to bump revision. Nov 16 03:12:15.860451 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 314} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:12:15.870741 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:15.871089 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Added segment 18372983-80c7-4077-9d6c-807fedaec4c7 of type vlan for network c8208389-f7af-46e2-99dd-85d422e4ee77 Nov 16 03:12:15.914440 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:15.940910 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:15.942360 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:12:15.942992 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:16.000415 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3724029 Nov 16 03:12:16.010343 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f070045b-da72-4581-a4df-91ea21159b1f admin admin] Pushing event updated for resources: {'Network': ['ID=c8208389-f7af-46e2-99dd-85d422e4ee77,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:12:16.026171 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network c8208389-f7af-46e2-99dd-85d422e4ee77 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:12:18.397957 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39562) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:12:18.427284 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-3dcf9554-3ebf-4a29-8d62-d8417ca71eea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:18.467905 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.pecan_wsgi.hooks.translation [None req-db526eef-15ef-4c66-9785-e1063cc8733e admin admin] GET failed (client error): The resource could not be found. Nov 16 03:12:18.469256 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-db526eef-15ef-4c66-9785-e1063cc8733e admin admin] 10.222.0.31 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0703230 Nov 16 03:12:18.543685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d70d84b-0484-4d79-bbbf-4336dd5cebd5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:12:18.545173 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3d70d84b-0484-4d79-bbbf-4336dd5cebd5 admin admin] 10.222.0.31 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0702460 Nov 16 03:12:18.556427 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77', 'ip_version': 4, 'cidr': '192.168.233.0/24', 'description': 'shared-subnet'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:12:18.579588 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Made reservation on behalf of fb897d934c0d40faa98082f63fe4c388 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:12:18.581943 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:18.764892 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:18.812374 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a28592e8-51b8-4f94-a27f-39d5db470e2c,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:12:18.831139 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Checking segment: {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:12:18.831586 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Network hostable DHCP agents. Network: c8208389-f7af-46e2-99dd-85d422e4ee77, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:12:18.849629 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Network c8208389-f7af-46e2-99dd-85d422e4ee77 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:12:18.859018 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, c8208389-f7af-46e2-99dd-85d422e4ee77) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:12:18.863210 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:12:18.863813 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:18.869852 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e27c2b5-c5bd-401c-9ef9-122cb8937393 None None] Network c8208389-f7af-46e2-99dd-85d422e4ee77 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:12:18.887640 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b6f29191-7da7-40d0-b875-bcf74a7eb412 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3345170 Nov 16 03:12:19.049366 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-c8208389-f7af-46e2-99dd-85d422e4ee77', 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77', 'tenant_id': 'fb897d934c0d40faa98082f63fe4c388', 'fixed_ips': [{'subnet_id': 'a28592e8-51b8-4f94-a27f-39d5db470e2c'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:12:19.050481 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:19.197700 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Allocated IP 192.168.233.2 (c8208389-f7af-46e2-99dd-85d422e4ee77/a28592e8-51b8-4f94-a27f-39d5db470e2c/1cf7e556-c294-475d-b216-8d0ec0e1d743) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:12:19.346978 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:19.353478 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:19.390754 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Network c8208389-f7af-46e2-99dd-85d422e4ee77 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:12:19.395964 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:12:19.399572 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:12:19.408236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Pushing event updated for resources: {'Port': ['ID=1cf7e556-c294-475d-b216-8d0ec0e1d743,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:12:19.431242 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.431929 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.431929 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.432227 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.432548 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.432868 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.433189 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.433536 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.433867 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.434184 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.434499 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.434812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:12:19.469268 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Attempting to bind port 1cf7e556-c294-475d-b216-8d0ec0e1d743 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:12:19.469519 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Attempting to bind port 1cf7e556-c294-475d-b216-8d0ec0e1d743 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:12:19.469770 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Attempting to bind port 1cf7e556-c294-475d-b216-8d0ec0e1d743 on network c8208389-f7af-46e2-99dd-85d422e4ee77 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:12:19.475829 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 11, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:12:19.476195 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Checking segment: {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:12:19.476586 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:19.476960 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Bound using segment: {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:12:19.477472 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Bound port: 1cf7e556-c294-475d-b216-8d0ec0e1d743, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:12:19.477843 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:19.546392 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] For port 1cf7e556-c294-475d-b216-8d0ec0e1d743, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:12:19.550616 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] For port 1cf7e556-c294-475d-b216-8d0ec0e1d743, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=1cf7e556-c294-475d-b216-8d0ec0e1d743,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:12:19.556677 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:19.619768 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36400b09-f498-44a4-9093-6fbe1a0d7e12 None None] Pushing event updated for resources: {'Port': ['ID=1cf7e556-c294-475d-b216-8d0ec0e1d743,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:12:19.706322 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:20.409283 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8967561-0b4a-4826-9f28-acefe021aae1 None None] Network c8208389-f7af-46e2-99dd-85d422e4ee77 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:12:20.479363 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-d19fc771-e7cc-4f42-9d82-55ac18dfb868 None None] Provisioning complete for port 1cf7e556-c294-475d-b216-8d0ec0e1d743 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:12:20.480043 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d19fc771-e7cc-4f42-9d82-55ac18dfb868 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:20.635225 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d19fc771-e7cc-4f42-9d82-55ac18dfb868 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:20.677944 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-d19fc771-e7cc-4f42-9d82-55ac18dfb868 None None] For port 1cf7e556-c294-475d-b216-8d0ec0e1d743, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=1cf7e556-c294-475d-b216-8d0ec0e1d743,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:12:20.685511 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d19fc771-e7cc-4f42-9d82-55ac18dfb868 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:20.731323 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19fc771-e7cc-4f42-9d82-55ac18dfb868 None None] Pushing event updated for resources: {'Port': ['ID=1cf7e556-c294-475d-b216-8d0ec0e1d743,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:12:20.906325 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-a8d736a2-99ca-4c37-9b7b-f302415cc09f None None] Provisioning complete for port 1cf7e556-c294-475d-b216-8d0ec0e1d743 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:12:20.906538 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a8d736a2-99ca-4c37-9b7b-f302415cc09f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:21.427594 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:21.567905 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:21.649625 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 1cf7e556-c294-475d-b216-8d0ec0e1d743 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:12:21.706191 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 1cf7e556-c294-475d-b216-8d0ec0e1d743 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:12:21.707220 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:43.953486 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:12:44.366774 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dce6c243-edea-44e7-98f3-ffb542018775 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:48.432175 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-936f4781-9e0a-4c23-aebb-1d12cfd9e256 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:49.705216 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:51.431915 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:12:51.566531 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:14.362262 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0f5bf88b-f20a-4c19-a8b8-25598b2d5add None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:18.438583 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d8263869-bcce-407f-8788-85e9be5512fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:19.708636 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:20.952918 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:13:21.433303 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:21.562042 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:31.857342 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39606) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:13:31.866962 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [None req-39b9f2e5-cb29-4e58-8bbf-59bf13e41047 tempest-verify_tempest_config-1333572044 tempest-verify_tempest_config-1333572044-project] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:13:31.868239 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-39b9f2e5-cb29-4e58-8bbf-59bf13e41047 tempest-verify_tempest_config-1333572044 tempest-verify_tempest_config-1333572044-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0096142 Nov 16 03:13:32.207501 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39624) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:13:32.324220 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.405071 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.410578 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.456771 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=7dd6bfae705743c39d15e3142f8d0e29&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2481482 Nov 16 03:13:32.457864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42908c70-e411-4628-afa3-0ad0f4c8031c,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:13:32.459600 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39630) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:13:32.465381 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.465744 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.466078 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.466398 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.466715 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.467045 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.467355 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.467687 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.468006 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.468312 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.468621 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.468931 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a68b465a-43c4-4767-8e83-25b45a505e41 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.558576 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.587158 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.686698 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.689331 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:32.690788 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/42908c70-e411-4628-afa3-0ad0f4c8031c HTTP/1.1" status: 204 len: 168 time: 0.2299230 Nov 16 03:13:32.699306 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42908c70-e411-4628-afa3-0ad0f4c8031c,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:13:32.710707 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.711073 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.711443 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.711751 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.712102 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.712445 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.712773 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.713074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.713443 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.713778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.714349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:32.714723 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e52764e-d2e0-4cb1-927d-a4fa54d80518 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:13:44.370830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87293b08-e83e-4b1f-b9f8-571289430e25 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:48.437878 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-cc18de8d-9969-4354-ae4d-eda430a0915c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:49.720477 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:51.439673 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:51.569533 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:13:57.953347 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:14:14.366590 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8af3f5d3-10a2-43a2-acc6-6dbcfd4d42e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:18.433612 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1ebd9001-d544-416b-8ff9-945f29e8712c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:19.715801 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:21.442944 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:21.565227 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:34.952396 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 5 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:14:44.362650 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c6a5f1ba-4b2e-4d22-9e4b-6ccb4bf42601 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:48.431574 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed690488-328a-403a-a810-bb20d17ccb47 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:49.720690 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:51.444597 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:14:51.568007 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:05.729163 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-565029'] for agent, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:11.954801 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:15:14.368931 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5aab5171-c339-4abb-989b-16c2289d07a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:18.427665 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c66fb1a3-dea7-455e-99e1-e9fd39cca69e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:19.721054 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:20.859396 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39702) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:15:20.981051 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-85912fe7-1aeb-4d94-8095-89e302013f11 admin admin] 10.222.0.31 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1204951 Nov 16 03:15:21.445937 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:21.562845 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:23.340295 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39712) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:15:23.401689 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-72db5f9f-6ada-4eb4-bd2e-cc131a8c0765 admin admin] 10.222.0.31 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0601754 Nov 16 03:15:35.697013 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:44.364269 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7f891391-0ae4-46d2-9c23-d563298b0e4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:48.437451 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ce6b8d0c-c2a3-40c3-9b67-92a7bfae450e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:48.957490 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:15:49.723817 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:51.453029 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:15:51.568450 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:05.702879 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:14.371531 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a60456c6-38ac-4a94-b024-f1f2d504635f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:18.435733 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2f03fb11-2774-4f20-a463-c5485012530c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:19.727045 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:21.455874 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:21.569717 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:25.956069 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:16:35.712313 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:44.366909 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-cedc5cae-42de-4496-84cb-1ae325dc429d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:48.441232 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8262879e-a5ce-43c5-8c0f-0f8c99981224 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:49.745111 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.486933 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.506035 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 39794) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:51.600764 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.740697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-632931434-network', 'tenant_id': 'b9840e08acad4f96a65962ff11498530'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:51.745702 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.quota [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Loaded quota_driver: . Nov 16 03:16:51.788140 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Made reservation on behalf of b9840e08acad4f96a65962ff11498530 for: {'network': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:16:51.791003 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.799756 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.903177 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.912549 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.954784 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc2b27c1-d719-401a-85be-f411edde75d4,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:51.961417 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 321} {{(pid=101899) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:16:51.972056 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.972411 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.972739 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.973076 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.973392 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.973911 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.974100 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.974509 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.974722 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.975034 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.975343 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.975650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Tracked resource versions report: Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: pushed versions: Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: { 'AddressGroup': {'1.2'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'ConntrackHelper': {'1.0'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Log': {'1.0'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Network': {'1.1'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Port': {'1.7'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'PortForwarding': {'1.2'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'QosPolicy': {'1.10'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroup': {'1.5'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SubPort': {'1.0'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Subnet': {'1.1'}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Trunk': {'1.1'}} Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: consumer versions: Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: HyperV agent@hv-cinder-81803: {}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'ConntrackHelper': '1.0', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Log': '1.0', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Network': '1.1', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Port': '1.7', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'PortForwarding': '1.2', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'QosPolicy': '1.10', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroup': '1.5', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SecurityGroupRule': '1.2', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'SubPort': '1.0', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Subnet': '1.1', Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: 'Trunk': '1.1'}} Nov 16 03:16:51.976682 dv-cinder-818037-1-iscsi neutron-server[101899]: {{(pid=101899) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:16:51.990652 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8789858107585', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:51.991472 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Unsubscribe: segment precommit_create {{(pid=101899) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 16 03:16:51.991472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.segments_db [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Added segment c87f961f-876c-4440-87a5-a87de8e1b0b6 of type vlan for network f95bded8-2028-40ca-9071-70ff49c6a60c Nov 16 03:16:52.065408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:52.107144 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:52.109195 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:52.109888 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:52.195514 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6832952 Nov 16 03:16:52.195824 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39846) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:52.201463 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Request body: {'subnet': {'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-632931434-subnet', 'tenant_id': 'b9840e08acad4f96a65962ff11498530', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:52.223205 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Made reservation on behalf of b9840e08acad4f96a65962ff11498530 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:16:52.225857 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:52.240155 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ad2bb2-ccdd-4215-ae92-ba8fd049e7fc admin admin] Pushing event updated for resources: {'Network': ['ID=f95bded8-2028-40ca-9071-70ff49c6a60c,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:52.256532 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network f95bded8-2028-40ca-9071-70ff49c6a60c details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:16:52.459817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:52.522088 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Pushing event updated for resources: {'Subnet': ['ID=62a9a221-1e05-4212-8fa0-766d2a72e114,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:52.535945 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.536654 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.537101 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.537410 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.537812 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.538149 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.538474 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.538806 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.539143 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.539458 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.539769 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.540077 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Tracked resource versions report: Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: pushed versions: Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: { 'AddressGroup': {'1.2'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'ConntrackHelper': {'1.0'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Log': {'1.0'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Network': {'1.1'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Port': {'1.7'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'PortForwarding': {'1.2'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'QosPolicy': {'1.10'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroup': {'1.5'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SubPort': {'1.0'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Subnet': {'1.1'}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Trunk': {'1.1'}} Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: consumer versions: Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: HyperV agent@hv-cinder-81803: {}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'ConntrackHelper': '1.0', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Log': '1.0', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Network': '1.1', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Port': '1.7', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'PortForwarding': '1.2', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'QosPolicy': '1.10', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroup': '1.5', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SecurityGroupRule': '1.2', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'SubPort': '1.0', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Subnet': '1.1', Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: 'Trunk': '1.1'}} Nov 16 03:16:52.541136 dv-cinder-818037-1-iscsi neutron-server[101898]: {{(pid=101898) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:16:52.552866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Checking segment: {'id': 'c87f961f-876c-4440-87a5-a87de8e1b0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:16:52.553226 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Network hostable DHCP agents. Network: f95bded8-2028-40ca-9071-70ff49c6a60c, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:16:52.576173 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Network f95bded8-2028-40ca-9071-70ff49c6a60c is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:16:52.590378 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, f95bded8-2028-40ca-9071-70ff49c6a60c) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:16:52.596278 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:52.597201 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:52.617742 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c26fea7f-7952-4fe4-9434-15c51fe3f345 None None] Network f95bded8-2028-40ca-9071-70ff49c6a60c requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:16:52.637175 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8d73f98f-cac0-449f-8214-553ad01a9541 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4369276 Nov 16 03:16:52.777595 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98019da5-11e8-4d74-b7e5-0d5af7656056 None None] Network f95bded8-2028-40ca-9071-70ff49c6a60c requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:16:54.084667 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39952) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:54.261400 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 39960) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:54.440162 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-network', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:54.471570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Made reservation on behalf of e487df53678d4cd890ccf9e6c950fa5e for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:16:54.474637 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.486446 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.501658 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-481106714-network', 'tenant_id': '61a2e084639344ff8e8d5ade2eef51d0'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:54.569869 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Made reservation on behalf of 61a2e084639344ff8e8d5ade2eef51d0 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:16:54.572430 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.584049 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.632193 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.642711 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.665767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 331} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:16:54.690155 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.690643 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Added segment d61b296a-1685-4eef-8945-c92743196c72 of type vlan for network b8800875-2e98-4cb6-a3a9-9d5ee637458a Nov 16 03:16:54.718193 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d59f1128-96e8-4a12-a73b-25548af67b95,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:54.752781 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.790552 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.791529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:54.792110 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.855852 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.866687 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.880128 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40004) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:54.880715 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.7942967 Nov 16 03:16:54.884908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f452bd2b-5cc5-47d6-9345-433363174817 admin admin] Pushing event updated for resources: {'Network': ['ID=b8800875-2e98-4cb6-a3a9-9d5ee637458a,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:54.886374 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Request body: {'subnet': {'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-subnet', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:54.895381 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 327} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:16:54.904141 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:16:54.923463 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.923847 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Added segment 494aff95-079c-4b92-b4fa-97068bf0b02b of type vlan for network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 Nov 16 03:16:54.928574 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Made reservation on behalf of e487df53678d4cd890ccf9e6c950fa5e for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:16:54.931348 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:54.939105 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22454019-d259-4e06-9dc4-92c4c9c77f03,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:54.983151 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.023255 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.024908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:55.025851 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.110972 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] Pushing event updated for resources: {'Network': ['ID=9a8436ad-09c6-4a61-8922-e3cc29d73f78,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:55.123679 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:16:55.132336 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-38987976-2198-449c-bc4a-5382fd4f7cfe admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.8668504 Nov 16 03:16:55.133099 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40030) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:55.144327 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Request body: {'subnet': {'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-481106714-subnet', 'tenant_id': '61a2e084639344ff8e8d5ade2eef51d0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:55.199934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Made reservation on behalf of 61a2e084639344ff8e8d5ade2eef51d0 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:16:55.203106 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.233296 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.305237 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d29e78fd-50ef-4647-88a4-83b1f418a6b5,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:55.333696 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Checking segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:16:55.334442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Network hostable DHCP agents. Network: b8800875-2e98-4cb6-a3a9-9d5ee637458a, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:16:55.466844 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:16:55.470619 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.489659 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, b8800875-2e98-4cb6-a3a9-9d5ee637458a) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:16:55.496351 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:55.498264 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.505134 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-319cbe5f-9477-4c2c-856a-9703079c66b2 None None] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:16:55.554245 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-31c51944-0976-43a8-a321-b8bbedaee1a1 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.6718488 Nov 16 03:16:55.554678 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40036) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:55.568080 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:16:55.598248 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:55.623408 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Checking segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:16:55.624025 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Network hostable DHCP agents. Network: 9a8436ad-09c6-4a61-8922-e3cc29d73f78, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:16:55.629667 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.630908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.667420 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:16:55.709062 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40052) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:55.711557 dv-cinder-818037-1-iscsi neutron-server[101899]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 16 03:16:55.774992 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c786038-3d33-4723-9c5e-42c7c06c44cb None None] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:16:55.792521 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 9a8436ad-09c6-4a61-8922-e3cc29d73f78) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:16:55.814710 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:55.815876 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.821847 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:55.887987 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-9d0fac75-70cf-436d-be73-92d40c91f68a admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7535577 Nov 16 03:16:55.932348 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-682c3d83-b6f5-444a-8c9b-2fad1ddf440b None None] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:16:56.022403 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-dc4253cf-a4fa-4f34-ba42-5ee674f737e5 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:56.024801 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-dc4253cf-a4fa-4f34-ba42-5ee674f737e5 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/networks?id=f95bded8-2028-40ca-9071-70ff49c6a60c HTTP/1.1" status: 200 len: 811 time: 0.3145709 Nov 16 03:16:56.060132 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-07379367-da15-4c44-afb2-c06a45c2b71b tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/quotas/b9840e08acad4f96a65962ff11498530 HTTP/1.1" status: 200 len: 375 time: 0.0289299 Nov 16 03:16:56.072957 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:56.150043 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-93244271-5ebd-48e6-bc4b-727aa7a05ffb tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=b9840e08acad4f96a65962ff11498530&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0876913 Nov 16 03:16:56.276067 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1dffe77-dc50-472b-a41b-b0ae2fc8e1c3 None None] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:16:56.375659 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:56.412840 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:56.568245 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Allocated IP 172.27.1.109 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/7f64383f-ace3-4b55-80d1-414d29eacb2f) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:16:56.705506 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:56.762690 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:56.805176 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:16:56.811437 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:16:56.822278 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:16:57.016760 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40118) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:57.121932 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Pushing event updated for resources: {'Port': ['ID=7f64383f-ace3-4b55-80d1-414d29eacb2f,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:57.369138 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:57.610343 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:57.636409 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40156) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:57.707661 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-1aa5c480-94f6-4f61-a1bc-c3020503ac1e service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:16:57.710608 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-1aa5c480-94f6-4f61-a1bc-c3020503ac1e service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.6260436 Nov 16 03:16:57.776225 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40160) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:57.907031 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Router fd8eae1b-2162-4723-a7c8-49cb2e850753 is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101898) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:16:57.936064 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b330b58-456d-4ede-bc04-e4ed26a2f70a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:57.970911 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-bb89042c-5325-4a3d-9dce-b81a954f78b2 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:16:57.972987 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-bb89042c-5325-4a3d-9dce-b81a954f78b2 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.3342335 Nov 16 03:16:58.035390 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-ba0e17b4-d2df-4a35-b405-4a9e6f155054 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/quotas/61a2e084639344ff8e8d5ade2eef51d0 HTTP/1.1" status: 200 len: 375 time: 0.0501194 Nov 16 03:16:58.078591 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-d7efc9ce-3b36-4a8f-8865-2ba1aa689887 service neutron] 10.222.0.31 "GET /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3172846 Nov 16 03:16:58.108608 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-241ba3c8-cac6-4607-a670-e16652bb7ec7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0540118 Nov 16 03:16:58.189047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b330b58-456d-4ede-bc04-e4ed26a2f70a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.199254 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b330b58-456d-4ede-bc04-e4ed26a2f70a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.212744 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:16:58.227974 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Sync routers for ids ['fd8eae1b-2162-4723-a7c8-49cb2e850753'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:16:58.245420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40182) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:58.251540 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8b330b58-456d-4ede-bc04-e4ed26a2f70a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=7f645d0b0f2d40129324fcd5a61c2d1c&name=default HTTP/1.1" status: 200 len: 2992 time: 1.2328095 Nov 16 03:16:58.255777 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40184) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:58.263584 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Routers {'fd8eae1b-2162-4723-a7c8-49cb2e850753'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:16:58.265112 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:16:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['fd8eae1b-2162-4723-a7c8-49cb2e850753'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:16:58.312509 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-6d622f23-f711-43f8-a1cc-bc493a857b1f service neutron] 10.222.0.31 "GET /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2329290 Nov 16 03:16:58.315736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b330b58-456d-4ede-bc04-e4ed26a2f70a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6f94084-4a58-44eb-a866-d0d28548771a,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:58.375128 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.384337 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-750077ae-89f5-4cf9-a55c-043b65b6b778 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 2.8256636 Nov 16 03:16:58.398063 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cf4a7a31-cf84-4707-9308-accb2cc5843a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.404422 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40188) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:58.452183 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d631085-a209-4ae6-a225-3fab6ea83b85 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.493864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d631085-a209-4ae6-a225-3fab6ea83b85 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.521420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40194) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:58.568821 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40198) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:58.657492 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d631085-a209-4ae6-a225-3fab6ea83b85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.666117 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d631085-a209-4ae6-a225-3fab6ea83b85 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.673310 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-4d631085-a209-4ae6-a225-3fab6ea83b85 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f6f94084-4a58-44eb-a866-d0d28548771a HTTP/1.1" status: 204 len: 168 time: 0.4159784 Nov 16 03:16:58.738181 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cfc24da5-8add-4cf6-b50d-438e459a4d48 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:58.761190 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d631085-a209-4ae6-a225-3fab6ea83b85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6f94084-4a58-44eb-a866-d0d28548771a,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:58.786589 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-15968a3d-06c3-408d-b8e6-ae4b55dc0cd3 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:16:58.788724 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-15968a3d-06c3-408d-b8e6-ae4b55dc0cd3 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1714690 Nov 16 03:16:58.846180 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Set router fd8eae1b-2162-4723-a7c8-49cb2e850753 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:16:59.029274 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cfc24da5-8add-4cf6-b50d-438e459a4d48 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.038055 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cfc24da5-8add-4cf6-b50d-438e459a4d48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.097036 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:16:57Z', 'revision_number': 3, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:16:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:16:59.102668 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87c442d-1a31-47d7-ab4a-f9d532469c14 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.113448 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-baddb552-b156-4144-b25f-cc62fe3ae255 req-f29a5641-9b1e-4a7d-97ee-3c73f2ce3fa4 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 210 time: 0.3228605 Nov 16 03:16:59.147634 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Checking router: fd8eae1b-2162-4723-a7c8-49cb2e850753 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:16:59.148274 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Updating router fd8eae1b-2162-4723-a7c8-49cb2e850753 port 7f64383f-ace3-4b55-80d1-414d29eacb2f binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:16:59.160566 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-cfc24da5-8add-4cf6-b50d-438e459a4d48 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cfee12c8cac74d1ea51217408535dc62&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5901015 Nov 16 03:16:59.170805 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40230) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:16:59.178530 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.182306 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc24da5-8add-4cf6-b50d-438e459a4d48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=142a3eae-1c87-42f3-8097-994bca814fbb,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:59.320699 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26c41a74-e2de-404c-8181-34b7bf0e9b05 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.333207 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-d5edd581-5dbd-4a72-8a7f-d14269bc10c5 service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4213250 Nov 16 03:16:59.366858 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26c41a74-e2de-404c-8181-34b7bf0e9b05 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.473378 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26c41a74-e2de-404c-8181-34b7bf0e9b05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.482533 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26c41a74-e2de-404c-8181-34b7bf0e9b05 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.484163 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4d84510b-f8cd-4157-9699-1a3989d08567 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.484744 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-26c41a74-e2de-404c-8181-34b7bf0e9b05 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/142a3eae-1c87-42f3-8097-994bca814fbb HTTP/1.1" status: 204 len: 168 time: 0.3118854 Nov 16 03:16:59.498719 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26c41a74-e2de-404c-8181-34b7bf0e9b05 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=142a3eae-1c87-42f3-8097-994bca814fbb,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:59.574186 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.584748 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.650645 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Attempting to bind port 7f64383f-ace3-4b55-80d1-414d29eacb2f on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:16:59.651122 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Attempting to bind port 7f64383f-ace3-4b55-80d1-414d29eacb2f by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:16:59.651587 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Attempting to bind port 7f64383f-ace3-4b55-80d1-414d29eacb2f on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:16:59.655742 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Pushing event updated for resources: {'Port': ['ID=7f64383f-ace3-4b55-80d1-414d29eacb2f,revision_number=2']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:16:59.665253 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 16, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:16:59.666100 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:16:59.666741 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.667352 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:16:59.668235 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Bound port: 7f64383f-ace3-4b55-80d1-414d29eacb2f, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:16:59.668893 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.673358 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.674064 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.674668 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.675216 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.676281 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.677031 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.677582 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.678229 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.678742 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.679257 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.679791 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.680264 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Tracked resource versions report: Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: pushed versions: Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: { 'AddressGroup': {'1.2'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'ConntrackHelper': {'1.0'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Log': {'1.0'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Network': {'1.1'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Port': {'1.7'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'PortForwarding': {'1.2'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'QosPolicy': {'1.10'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroup': {'1.5'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SubPort': {'1.0'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Subnet': {'1.1'}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Trunk': {'1.1'}} Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: consumer versions: Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: HyperV agent@hv-cinder-81803: {}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'ConntrackHelper': '1.0', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Log': '1.0', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Network': '1.1', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Port': '1.7', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'PortForwarding': '1.2', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'QosPolicy': '1.10', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroup': '1.5', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SecurityGroupRule': '1.2', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'SubPort': '1.0', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Subnet': '1.1', Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: 'Trunk': '1.1'}} Nov 16 03:16:59.682349 dv-cinder-818037-1-iscsi neutron-server[101901]: {{(pid=101901) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:16:59.720494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4d84510b-f8cd-4157-9699-1a3989d08567 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.775267 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] For port 7f64383f-ace3-4b55-80d1-414d29eacb2f, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:16:59.776359 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4d84510b-f8cd-4157-9699-1a3989d08567 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.781127 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] For port 7f64383f-ace3-4b55-80d1-414d29eacb2f, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=7f64383f-ace3-4b55-80d1-414d29eacb2f,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:16:59.790705 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.860624 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Routers {'fd8eae1b-2162-4723-a7c8-49cb2e850753'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:16:59.861723 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:16:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['fd8eae1b-2162-4723-a7c8-49cb2e850753'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:16:59.933692 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cf4a7a31-cf84-4707-9308-accb2cc5843a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.963129 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-9d40c654-4103-464f-b444-0eccbf5e4a5e service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5173004 Nov 16 03:16:59.982673 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cf4a7a31-cf84-4707-9308-accb2cc5843a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:16:59.986798 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4d84510b-f8cd-4157-9699-1a3989d08567 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=12882c2b76424e97b392e96c1a834ed9&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4639456 Nov 16 03:16:59.989680 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40260) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:00.006484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d84510b-f8cd-4157-9699-1a3989d08567 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fe11e26-7375-43f2-9f77-240c4572d5c0,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:00.019333 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] Set router fd8eae1b-2162-4723-a7c8-49cb2e850753 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:17:00.076954 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40266) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:00.106350 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e53619-62a3-4fd9-a496-6720b19e4968 None None] Pushing event updated for resources: {'Port': ['ID=7f64383f-ace3-4b55-80d1-414d29eacb2f,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:00.128190 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ef0d34f3-2e17-42d9-861f-4206deb39b3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.140408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87c442d-1a31-47d7-ab4a-f9d532469c14 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.162849 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87c442d-1a31-47d7-ab4a-f9d532469c14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.179868 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-cf4a7a31-cf84-4707-9308-accb2cc5843a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e4d221503ed04c31b9199525233a4bdc&name=default HTTP/1.1" status: 200 len: 2992 time: 2.4008539 Nov 16 03:17:00.190532 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40270) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:00.203401 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4a7a31-cf84-4707-9308-accb2cc5843a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e2fb729-a7fd-4d85-a36b-27c976fd8ca7,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:00.235934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e1df4fea-e6d7-4390-b711-613511d51c32 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.377047 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:16:57Z', 'revision_number': 3, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:16:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:00.385012 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e1df4fea-e6d7-4390-b711-613511d51c32 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.445269 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-093e3305-3e77-4d85-9f24-f3efb98fead7 None None] The sync data for ids ['fd8eae1b-2162-4723-a7c8-49cb2e850753'] in dv-cinder-818037-1-iscsi is: [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:16:57Z', 'revision_number': 3, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:16:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:17:00.511711 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ef0d34f3-2e17-42d9-861f-4206deb39b3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.513836 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e1df4fea-e6d7-4390-b711-613511d51c32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.517321 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e1df4fea-e6d7-4390-b711-613511d51c32 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.518919 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e1df4fea-e6d7-4390-b711-613511d51c32 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/3fe11e26-7375-43f2-9f77-240c4572d5c0 HTTP/1.1" status: 204 len: 168 time: 0.5271277 Nov 16 03:17:00.528824 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ef0d34f3-2e17-42d9-861f-4206deb39b3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.532277 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1df4fea-e6d7-4390-b711-613511d51c32 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fe11e26-7375-43f2-9f77-240c4572d5c0,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:00.583815 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ef0d34f3-2e17-42d9-861f-4206deb39b3a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8be11fc7db6b418cba9a8f29d90162ee&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5071139 Nov 16 03:17:00.584767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef0d34f3-2e17-42d9-861f-4206deb39b3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=568a3332-bdb0-4382-9087-9a492058c64f,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:00.587393 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40294) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:00.649922 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f925f3b1-560f-4e62-8676-ea1a9a22d064 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.667372 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40296) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:00.715636 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f925f3b1-560f-4e62-8676-ea1a9a22d064 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.805791 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef848c75-2537-4231-b2ec-c05f3c4643a3 req-8ed9dacc-6dac-4666-b695-920390e5f02d tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 210 time: 0.5754666 Nov 16 03:17:00.845082 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f925f3b1-560f-4e62-8676-ea1a9a22d064 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.848385 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f925f3b1-560f-4e62-8676-ea1a9a22d064 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:00.852792 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f925f3b1-560f-4e62-8676-ea1a9a22d064 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/568a3332-bdb0-4382-9087-9a492058c64f HTTP/1.1" status: 204 len: 168 time: 0.2613115 Nov 16 03:17:00.868114 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f925f3b1-560f-4e62-8676-ea1a9a22d064 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=568a3332-bdb0-4382-9087-9a492058c64f,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:00.906388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2037288235-network', 'tenant_id': '97e68b408d034c0c8857be85e3ca59f5'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:00.922822 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a87c442d-1a31-47d7-ab4a-f9d532469c14 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=56aae1d7526145a0b92518c507f24343&name=default HTTP/1.1" status: 200 len: 2992 time: 2.6673999 Nov 16 03:17:00.926355 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40310) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:00.984942 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9d7007fe-09cc-4ce3-ab6b-1ea2787734b8 req-839cccc4-a70a-433d-b0c9-8ce10841f1ef tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 210 time: 0.2264605 Nov 16 03:17:00.986744 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87c442d-1a31-47d7-ab4a-f9d532469c14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42947027-4993-490a-9dd5-45261bd8996f,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:01.069251 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Made reservation on behalf of 97e68b408d034c0c8857be85e3ca59f5 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:01.076833 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-00116545-3f82-4027-abc9-2f7f1724bd43 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.078175 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.113324 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.286019 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1cf34281-448b-4b47-bc05-caa6d6c6662d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.354507 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-00116545-3f82-4027-abc9-2f7f1724bd43 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.369515 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1cf34281-448b-4b47-bc05-caa6d6c6662d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.441934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.456991 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.517484 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-151771da-5ded-453d-914c-056d903b696e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 322} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:17:01.552857 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa55705c-d06e-4e97-a609-8c05f664dde3,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:01.570692 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1cf34281-448b-4b47-bc05-caa6d6c6662d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.594550 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1cf34281-448b-4b47-bc05-caa6d6c6662d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.595756 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1cf34281-448b-4b47-bc05-caa6d6c6662d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/42947027-4993-490a-9dd5-45261bd8996f HTTP/1.1" status: 204 len: 168 time: 0.6690125 Nov 16 03:17:01.604886 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-00116545-3f82-4027-abc9-2f7f1724bd43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.608178 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.608708 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Added segment 5020bc9e-ed8b-4919-ab17-6d9f1feb97ec of type vlan for network 9e9bacc6-d435-4716-b3de-1d8db6721725 Nov 16 03:17:01.610655 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-00116545-3f82-4027-abc9-2f7f1724bd43 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.616414 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-00116545-3f82-4027-abc9-2f7f1724bd43 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/0e2fb729-a7fd-4d85-a36b-27c976fd8ca7 HTTP/1.1" status: 204 len: 168 time: 1.3892593 Nov 16 03:17:01.688319 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.693480 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00116545-3f82-4027-abc9-2f7f1724bd43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e2fb729-a7fd-4d85-a36b-27c976fd8ca7,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:01.708832 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.732465 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.733830 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:01.734876 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.740430 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf34281-448b-4b47-bc05-caa6d6c6662d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42947027-4993-490a-9dd5-45261bd8996f,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:01.839618 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-151771da-5ded-453d-914c-056d903b696e admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.1707067 Nov 16 03:17:01.848664 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40338) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:01.858615 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Request body: {'subnet': {'network_id': '9e9bacc6-d435-4716-b3de-1d8db6721725', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2037288235-subnet', 'tenant_id': '97e68b408d034c0c8857be85e3ca59f5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:01.932872 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Made reservation on behalf of 97e68b408d034c0c8857be85e3ca59f5 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:01.945117 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:01.949355 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151771da-5ded-453d-914c-056d903b696e admin admin] Pushing event updated for resources: {'Network': ['ID=9e9bacc6-d435-4716-b3de-1d8db6721725,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:02.007279 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40340) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:02.159708 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-215cf192-0c92-4ee1-b924-443d877dfe3f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.165471 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.11', 53874) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:02.300290 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 9e9bacc6-d435-4716-b3de-1d8db6721725 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:17:02.499614 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 7f64383f-ace3-4b55-80d1-414d29eacb2f up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:02.521361 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dce96437-6ed2-4f16-b035-343aa08078a7 req-21eb3175-559c-467d-8f44-9334324fa952 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 210 time: 0.0956807 Nov 16 03:17:02.596042 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-30b11df2-85d8-4d79-898b-0b193f5e05d8 req-eccad96f-2285-4eff-a36b-eacf875b8954 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 210 time: 0.1704357 Nov 16 03:17:02.607263 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40358) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:02.633963 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b7124c1c-72eb-4e67-8ed2-7612b10ae5d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.730611 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-215cf192-0c92-4ee1-b924-443d877dfe3f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.744202 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-215cf192-0c92-4ee1-b924-443d877dfe3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.793977 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b7124c1c-72eb-4e67-8ed2-7612b10ae5d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.800603 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Allocated IP 172.20.0.1 (b8800875-2e98-4cb6-a3a9-9d5ee637458a/d29e78fd-50ef-4647-88a4-83b1f418a6b5/a9dd54a6-2e04-4400-93de-25f6cdedcfd0) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:17:02.804469 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.819157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215cf192-0c92-4ee1-b924-443d877dfe3f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2f6a00d-c710-4c83-b452-3ff668132db6,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:02.826825 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b7124c1c-72eb-4e67-8ed2-7612b10ae5d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.832662 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 7f64383f-ace3-4b55-80d1-414d29eacb2f triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:02.836708 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:02.863574 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-215cf192-0c92-4ee1-b924-443d877dfe3f admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=aaccbdb35286412a883c7cd4bbb09535&name=default HTTP/1.1" status: 200 len: 2993 time: 0.8524458 Nov 16 03:17:02.869817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40366) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:02.898862 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7124c1c-72eb-4e67-8ed2-7612b10ae5d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4aaf963-f6ff-49cb-97ba-1f14898141e6,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:02.936376 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9ddbaf1f-9f20-40fc-9156-17922ca5fde6,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:02.970627 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:17:02.976566 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Checking segment: {'id': '5020bc9e-ed8b-4919-ab17-6d9f1feb97ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 322, 'network_id': '9e9bacc6-d435-4716-b3de-1d8db6721725'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:02.977194 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Network hostable DHCP agents. Network: 9e9bacc6-d435-4716-b3de-1d8db6721725, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:17:02.986248 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-85b15068-7aeb-47f3-a0b9-42864ae2d370 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:02.988422 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-85b15068-7aeb-47f3-a0b9-42864ae2d370 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.11 "GET /v2.0/networks?id=f95bded8-2028-40ca-9071-70ff49c6a60c HTTP/1.1" status: 200 len: 811 time: 0.8172970 Nov 16 03:17:03.011310 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32503b2a-0a43-403d-a6be-0d5ae9ffa0ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.027561 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Network 9e9bacc6-d435-4716-b3de-1d8db6721725 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:17:03.059292 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32503b2a-0a43-403d-a6be-0d5ae9ffa0ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.082023 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b7124c1c-72eb-4e67-8ed2-7612b10ae5d8 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ddf75dba3913407cac173b259f779df2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4703300 Nov 16 03:17:03.092694 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 9e9bacc6-d435-4716-b3de-1d8db6721725) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:03.094704 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40372) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:03.116993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Request body: {'port': {'device_id': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c', 'admin_state_up': True, 'tenant_id': 'b9840e08acad4f96a65962ff11498530'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:03.119142 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-338c1795-657d-430a-be43-42eb85cc0e81 None None] Network 9e9bacc6-d435-4716-b3de-1d8db6721725 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:17:03.177779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:03.178398 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.281942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-468f15d8-5e21-4c76-af5a-e087679e0ae7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.289519 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-6417895a-8a6e-4455-bfe3-22de260c65c5 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.4390955 Nov 16 03:17:03.289996 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.316478 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-468f15d8-5e21-4c76-af5a-e087679e0ae7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.328213 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 7f64383f-ace3-4b55-80d1-414d29eacb2f, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=7f64383f-ace3-4b55-80d1-414d29eacb2f,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:03.343103 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.382241 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32503b2a-0a43-403d-a6be-0d5ae9ffa0ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.385226 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32503b2a-0a43-403d-a6be-0d5ae9ffa0ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.388985 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-32503b2a-0a43-403d-a6be-0d5ae9ffa0ba admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/e2f6a00d-c710-4c83-b452-3ff668132db6 HTTP/1.1" status: 204 len: 168 time: 0.5114467 Nov 16 03:17:03.422268 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32503b2a-0a43-403d-a6be-0d5ae9ffa0ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2f6a00d-c710-4c83-b452-3ff668132db6,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:03.462612 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-468f15d8-5e21-4c76-af5a-e087679e0ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.465771 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-468f15d8-5e21-4c76-af5a-e087679e0ae7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.473469 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-468f15d8-5e21-4c76-af5a-e087679e0ae7 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/d4aaf963-f6ff-49cb-97ba-1f14898141e6 HTTP/1.1" status: 204 len: 168 time: 0.3575015 Nov 16 03:17:03.527160 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468f15d8-5e21-4c76-af5a-e087679e0ae7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4aaf963-f6ff-49cb-97ba-1f14898141e6,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:03.532408 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=7f64383f-ace3-4b55-80d1-414d29eacb2f,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:03.548927 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.549615 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.550096 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.550842 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.551401 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.552555 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.553260 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.553511 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40394) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:03.554083 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.554614 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.555187 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.555851 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.556394 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Tracked resource versions report: Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: pushed versions: Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: { 'AddressGroup': {'1.2'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'ConntrackHelper': {'1.0'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Log': {'1.0'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Network': {'1.1'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Port': {'1.7'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'PortForwarding': {'1.2'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'QosPolicy': {'1.10'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroup': {'1.5'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroupRule': {'1.2'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SubPort': {'1.0'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Subnet': {'1.1'}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Trunk': {'1.1'}} Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: consumer versions: Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: { DHCP agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: HyperV agent@hv-cinder-81803: {}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: L3 agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: Metadata agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: Metering agent@dv-cinder-818037-1-iscsi: {}, Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: Open vSwitch agent@dv-cinder-818037-1-iscsi: { 'AddressGroup': '1.2', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'ConntrackHelper': '1.0', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Log': '1.0', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Network': '1.1', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Port': '1.7', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'PortForwarding': '1.2', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'QosPolicy': '1.10', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroup': '1.5', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SecurityGroupRule': '1.2', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'SubPort': '1.0', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Subnet': '1.1', Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: 'Trunk': '1.1'}} Nov 16 03:17:03.577706 dv-cinder-818037-1-iscsi neutron-server[101900]: {{(pid=101900) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 16 03:17:03.594004 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5efc794e-d55c-4716-9225-6c5771a28d28 None None] Network 9e9bacc6-d435-4716-b3de-1d8db6721725 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:17:03.604075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8a6127ad-e7de-4aa8-9007-9191536968f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.618584 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.11', 53880) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:03.869247 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8a6127ad-e7de-4aa8-9007-9191536968f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.877028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8a6127ad-e7de-4aa8-9007-9191536968f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:03.908224 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 7f64383f-ace3-4b55-80d1-414d29eacb2f up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:03.929171 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8a6127ad-e7de-4aa8-9007-9191536968f6 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d6106de212c64a39b58588b6e2bd05c2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3741388 Nov 16 03:17:03.930515 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6127ad-e7de-4aa8-9007-9191536968f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1eb47d54-34a7-406e-80f3-d769d30dff92,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:03.933725 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40406) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:03.946489 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.001253 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 7f64383f-ace3-4b55-80d1-414d29eacb2f triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:04.001807 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.061283 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b29efb12-4f59-4d8f-9cbe-beed482f712a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.090435 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b95d66c3-02ef-4a50-8c8f-2322824d85b0 req-25e409e3-d1d9-4261-ba0a-d6a5dfdf1e7b tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 210 time: 0.2684364 Nov 16 03:17:04.091085 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Made reservation on behalf of b9840e08acad4f96a65962ff11498530 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:04.095168 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.131677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b29efb12-4f59-4d8f-9cbe-beed482f712a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.242492 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b29efb12-4f59-4d8f-9cbe-beed482f712a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.247188 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b29efb12-4f59-4d8f-9cbe-beed482f712a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.252094 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b29efb12-4f59-4d8f-9cbe-beed482f712a admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1eb47d54-34a7-406e-80f3-d769d30dff92 HTTP/1.1" status: 204 len: 168 time: 0.3145835 Nov 16 03:17:04.260065 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29efb12-4f59-4d8f-9cbe-beed482f712a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1eb47d54-34a7-406e-80f3-d769d30dff92,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:04.293409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0eb32ce8-0a1d-448b-b9a8-7c4ad9a9c817 req-6a8e6286-ac4e-4dd7-a763-f19f35e94e41 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 210 time: 0.1425564 Nov 16 03:17:04.356618 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-7a7a86af-f621-4820-9aeb-7970ee00f88a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:04.358995 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-7a7a86af-f621-4820-9aeb-7970ee00f88a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.7335329 Nov 16 03:17:04.372144 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.413836 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Request body: {'port': {'device_id': 'b88a542c-0928-49cd-81c8-e95440adc731', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'admin_state_up': True, 'tenant_id': '61a2e084639344ff8e8d5ade2eef51d0'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:04.454725 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:17:04.516224 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:04.532421 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:17:04.533040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:04.769901 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Allocated IP 172.20.0.11 (f95bded8-2028-40ca-9071-70ff49c6a60c/62a9a221-1e05-4212-8fa0-766d2a72e114/d7068ec0-21b9-465d-9309-774abd9482b7) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:17:04.773931 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Pushing event updated for resources: {'Port': ['ID=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:04.955882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Made reservation on behalf of 61a2e084639344ff8e8d5ade2eef51d0 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:04.959965 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:05.338459 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:05.469327 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0a52d79-1cc4-4fdf-a59d-57aaf6fc715e req-f163ee79-c311-424c-9f77-0d01e5c34fc3 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 210 time: 0.1151514 Nov 16 03:17:05.674809 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7a68d98-5fe3-4756-8ed7-05930f1276c2 req-c2e04a2d-7bb9-40bf-8533-a579345f398b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 210 time: 0.1369760 Nov 16 03:17:05.703791 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:05.749380 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:05.769412 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Allocated IP 172.20.0.11 (9a8436ad-09c6-4a61-8922-e3cc29d73f78/a3fb04df-83c0-4d51-afa7-1e0694c8dbc3/f7e69534-b12b-41e4-b78d-014ae8dee4db) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:17:05.939611 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.106195 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.134400 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Network f95bded8-2028-40ca-9071-70ff49c6a60c is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:17:06.143895 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.144750 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.165218 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:06.197865 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:17:06.218049 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:06.218740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.222124 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Pushing event updated for resources: {'Port': ['ID=d7068ec0-21b9-465d-9309-774abd9482b7,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:06.505535 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2eb37b99-bf06-4e82-8dcb-b693fae041e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.4191134 Nov 16 03:17:06.512189 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.521940 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Pushing event updated for resources: {'Port': ['ID=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:06.686541 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.744810 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:17:06.756246 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:06.778815 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:17:06.793221 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd62562-2a3b-464d-ac0d-b7891de7766f req-3dd23113-761b-4129-910b-d183cd5ef92a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:06.801491 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9dd62562-2a3b-464d-ac0d-b7891de7766f req-3dd23113-761b-4129-910b-d183cd5ef92a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 932 time: 0.1715205 Nov 16 03:17:06.818911 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:06.840848 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:17:06.852442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:06.852442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:06.953894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event updated for resources: {'Port': ['ID=f7e69534-b12b-41e4-b78d-014ae8dee4db,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:07.037609 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-0c92dc7a-6a1c-4100-8283-52259d9aca98 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6542151 Nov 16 03:17:07.063219 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9dd62562-2a3b-464d-ac0d-b7891de7766f req-eb566d00-9bc1-4179-9332-c013f85ec26d tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2560208 Nov 16 03:17:07.115842 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646e9b04-5c02-41c4-a495-3796982a8d7d req-2ef12586-558b-4a1f-bad3-9e456c9642b1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:07.117415 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-646e9b04-5c02-41c4-a495-3796982a8d7d req-2ef12586-558b-4a1f-bad3-9e456c9642b1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 932 time: 0.1735332 Nov 16 03:17:07.127506 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Router fd8eae1b-2162-4723-a7c8-49cb2e850753 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:17:07.350866 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-646e9b04-5c02-41c4-a495-3796982a8d7d req-38e01e69-90f9-4dd3-b275-587f4386f9f6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2195039 Nov 16 03:17:07.434664 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:17:07.445938 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f03501d0-e072-435c-acfe-9ded86d54a83 admin admin] 10.222.0.31 "PUT /v2.0/routers/fd8eae1b-2162-4723-a7c8-49cb2e850753/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.0387826 Nov 16 03:17:07.462531 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Sync routers for ids ['fd8eae1b-2162-4723-a7c8-49cb2e850753'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:17:07.483860 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Routers {'fd8eae1b-2162-4723-a7c8-49cb2e850753'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:17:07.485691 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:16:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['fd8eae1b-2162-4723-a7c8-49cb2e850753'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:07.684233 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40490) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:07.693864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1919061730-network', 'tenant_id': 'cb501663d9634cfcbb8766c325f9229d'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:07.766311 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Made reservation on behalf of cb501663d9634cfcbb8766c325f9229d for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:07.772430 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:07.787362 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:07.833349 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Set router fd8eae1b-2162-4723-a7c8-49cb2e850753 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:17:07.947129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:07.954006 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:07.976218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 333} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:17:08.008440 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:08.008824 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Added segment 4e7e9395-18af-4a5f-aec4-c471373c4dad of type vlan for network 4b099bbb-f179-45d7-9de0-63a371065c00 Nov 16 03:17:08.113895 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:08.152284 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-de7058c4-4d04-439d-82d3-511d931eaf41 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:17:08.154538 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-de7058c4-4d04-439d-82d3-511d931eaf41 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0063064 Nov 16 03:17:08.161577 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-8f6b7d42-9adf-4b4d-a79f-50f6bc9b473c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:17:08.168794 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-8f6b7d42-9adf-4b4d-a79f-50f6bc9b473c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0128069 Nov 16 03:17:08.192224 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:08.194689 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:08.198151 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:08.322810 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Pushing event updated for resources: {'Network': ['ID=4b099bbb-f179-45d7-9de0-63a371065c00,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:08.341000 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 4b099bbb-f179-45d7-9de0-63a371065c00 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:17:08.344561 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.6550777 Nov 16 03:17:08.352817 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46a2f75-a934-4bb5-bcfb-cb0f1ebc50f3 req-fe9e6f25-eda1-4272-b5e4-673fddefb1f9 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:08.354993 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40506) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:08.361019 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Request body: {'subnet': {'network_id': '4b099bbb-f179-45d7-9de0-63a371065c00', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1919061730-subnet', 'tenant_id': 'cb501663d9634cfcbb8766c325f9229d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:08.370599 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f46a2f75-a934-4bb5-bcfb-cb0f1ebc50f3 req-fe9e6f25-eda1-4272-b5e4-673fddefb1f9 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 932 time: 0.1574562 Nov 16 03:17:08.478532 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Made reservation on behalf of cb501663d9634cfcbb8766c325f9229d for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:08.491693 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:08.703856 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f46a2f75-a934-4bb5-bcfb-cb0f1ebc50f3 req-e28ac589-2655-4fca-97b9-073fd9fb4f2d tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3319576 Nov 16 03:17:08.740232 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:17:05Z', 'revision_number': 4, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:17:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': 'a9dd54a6-2e04-4400-93de-25f6cdedcfd0', 'name': '', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'mac_address': 'fa:16:3e:6e:31:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:17:01Z', 'updated_at': '2021-11-16T03:17:05Z', 'revision_number': 2, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'subnets': [{'id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:08.744888 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565fb78f-49c3-433c-b459-f65920281c14 req-38550f24-9988-4107-b4d0-1394c1555f04 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:08.746941 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-565fb78f-49c3-433c-b459-f65920281c14 req-38550f24-9988-4107-b4d0-1394c1555f04 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 932 time: 0.1988614 Nov 16 03:17:08.791895 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Checking router: fd8eae1b-2162-4723-a7c8-49cb2e850753 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:17:08.792559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Updating router fd8eae1b-2162-4723-a7c8-49cb2e850753 port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:17:08.891268 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:08.899839 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf05b2e-31c6-4a19-8398-c031a7973686 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f157a820-faf2-4ead-95b6-b4d72cf3e605,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:08.904751 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-565fb78f-49c3-433c-b459-f65920281c14 req-cf3ece4e-414d-4998-8105-d1a3fdeea395 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1498981 Nov 16 03:17:09.291032 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:09.471480 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=28b5baae-6fb4-47a0-9731-4c8618a4b142,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:09.520438 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Checking segment: {'id': '4e7e9395-18af-4a5f-aec4-c471373c4dad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 333, 'network_id': '4b099bbb-f179-45d7-9de0-63a371065c00'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:09.521010 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Network hostable DHCP agents. Network: 4b099bbb-f179-45d7-9de0-63a371065c00, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:17:09.578924 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Network 4b099bbb-f179-45d7-9de0-63a371065c00 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:17:09.594683 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 4b099bbb-f179-45d7-9de0-63a371065c00) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:09.600968 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:09.601741 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:09.636542 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec04c7de-5348-4e11-8a73-f55394d21937 None None] Network 4b099bbb-f179-45d7-9de0-63a371065c00 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:17:09.654356 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-5e8cd9dc-c032-4f81-ade6-06d0ce5b0dd3 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.2842104 Nov 16 03:17:10.029554 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-309c1dea-8a88-40fa-a48f-3db97b449748 req-d7901ab5-3a18-4a3e-b78a-8fbbf67cde66 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:10.037126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-309c1dea-8a88-40fa-a48f-3db97b449748 req-d7901ab5-3a18-4a3e-b78a-8fbbf67cde66 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 932 time: 0.1762314 Nov 16 03:17:10.250386 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-309c1dea-8a88-40fa-a48f-3db97b449748 req-aa5f7d43-375b-41f9-8c9f-095d5bb96f74 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1949098 Nov 16 03:17:10.476626 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:10.547700 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:10.665893 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eac83907-9a88-47e4-921b-86ba847cf1a7 None None] Network 4b099bbb-f179-45d7-9de0-63a371065c00 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:17:10.697636 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f0dcef-8600-4fd6-a39b-900f9ba4da68 None None] Pushing event updated for resources: {'Port': ['ID=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:10.761291 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Request body: {'port': {'device_id': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:10.787161 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Request body: {'port': {'device_id': 'b88a542c-0928-49cd-81c8-e95440adc731', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:11.037771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ed3e92-a4d5-4110-a65f-c422665360e4 req-ea0288e7-0516-48fb-8468-003c1df42d95 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:11.040640 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d6ed3e92-a4d5-4110-a65f-c422665360e4 req-ea0288e7-0516-48fb-8468-003c1df42d95 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 932 time: 0.2884645 Nov 16 03:17:11.125820 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:11.333906 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:11.352567 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Attempting to bind port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:17:11.353060 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Attempting to bind port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:17:11.353422 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Attempting to bind port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:11.362649 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 16, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:17:11.363026 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Checking segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:11.363433 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:11.363819 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Bound using segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:17:11.364814 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Bound port: a9dd54a6-2e04-4400-93de-25f6cdedcfd0, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:17:11.364994 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:11.437739 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-dac51068-c117-42bf-b7ac-952c49814d8a tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:11.444668 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-dac51068-c117-42bf-b7ac-952c49814d8a tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 819 time: 1.1736851 Nov 16 03:17:11.446532 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40562) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:11.508767 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] For port a9dd54a6-2e04-4400-93de-25f6cdedcfd0, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:17:11.524324 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] For port a9dd54a6-2e04-4400-93de-25f6cdedcfd0, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:17:11.532846 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:11.608213 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f0dcef-8600-4fd6-a39b-900f9ba4da68 None None] Pushing event updated for resources: {'Port': ['ID=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:11.675328 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Routers {'fd8eae1b-2162-4723-a7c8-49cb2e850753'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:17:11.677938 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:16:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['fd8eae1b-2162-4723-a7c8-49cb2e850753'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:11.741794 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Deleting subnet 9ddbaf1f-9f20-40fc-9156-17922ca5fde6 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:17:11.764431 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:11.775327 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d6ed3e92-a4d5-4110-a65f-c422665360e4 req-82f3c68e-5cb3-4c71-8d01-9cdc4e591687 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7163584 Nov 16 03:17:11.914715 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-c08b0040-4fee-4ad8-b7a2-0cc1f420520e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/quotas/e487df53678d4cd890ccf9e6c950fa5e HTTP/1.1" status: 200 len: 375 time: 0.4418330 Nov 16 03:17:11.960679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:12.005269 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:12.117416 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] Set router fd8eae1b-2162-4723-a7c8-49cb2e850753 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:17:12.256162 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:12.359134 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9ddbaf1f-9f20-40fc-9156-17922ca5fde6,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:12.435452 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:12.447439 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7061795b-447d-488e-a179-e88c6870182a admin admin] 10.222.0.31 "DELETE /v2.0/subnets/9ddbaf1f-9f20-40fc-9156-17922ca5fde6 HTTP/1.1" status: 204 len: 168 time: 0.9982562 Nov 16 03:17:12.454368 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40572) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:12.533518 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:17:05Z', 'revision_number': 4, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:17:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': 'a9dd54a6-2e04-4400-93de-25f6cdedcfd0', 'name': '', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'mac_address': 'fa:16:3e:6e:31:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:17:01Z', 'updated_at': '2021-11-16T03:17:11Z', 'revision_number': 4, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'subnets': [{'id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:12.620798 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a24b1f8b-b403-46bd-a5c0-4356258a6c88 None None] The sync data for ids ['fd8eae1b-2162-4723-a7c8-49cb2e850753'] in dv-cinder-818037-1-iscsi is: [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:17:05Z', 'revision_number': 4, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:17:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': 'a9dd54a6-2e04-4400-93de-25f6cdedcfd0', 'name': '', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'mac_address': 'fa:16:3e:6e:31:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:17:01Z', 'updated_at': '2021-11-16T03:17:11Z', 'revision_number': 4, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'subnets': [{'id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:17:12.865183 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:13.216328 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac15a928-739f-4b23-9ffa-ab628e8d6821 req-29ca1228-8020-4c68-aaaa-eaba34d5e81e tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:13.230336 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ac15a928-739f-4b23-9ffa-ab628e8d6821 req-29ca1228-8020-4c68-aaaa-eaba34d5e81e tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 932 time: 1.1332986 Nov 16 03:17:13.258721 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-9e5501ab-e40c-4066-a60a-b313ece6ad62 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&fields=id HTTP/1.1" status: 200 len: 255 time: 1.3423595 Nov 16 03:17:13.298377 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:13.377176 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.380433 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.383424 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.387328 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > port after_create 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.391899 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > port after_delete 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.392612 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > port after_update 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.393209 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.393807 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.394346 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.394879 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:13.752464 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7068ec0-21b9-465d-9309-774abd9482b7 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:13.769187 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.017797 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a9dd54a6-2e04-4400-93de-25f6cdedcfd0 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:14.139985 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ac15a928-739f-4b23-9ffa-ab628e8d6821 req-6173dc7d-fb90-479f-9113-2010229d09c6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9017217 Nov 16 03:17:14.142568 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Transition to ACTIVE for port object d7068ec0-21b9-465d-9309-774abd9482b7 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:17:14.278274 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:14.278659 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.324265 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:14.325224 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:14.332059 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:14.332724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101898) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:17:14.348051 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e9bacc6-d435-4716-b3de-1d8db6721725']}} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:14.353765 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.436401 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5020bc9e-ed8b-4919-ab17-6d9f1feb97ec') {'for_net_delete': True} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:14.443198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5020bc9e-ed8b-4919-ab17-6d9f1feb97ec') {} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:14.520049 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129419530'] for segment, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.522704 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2fded6aa-60d1-46fe-8b79-01a9142fc51c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.609950 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.650244 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Releasing vlan 322 on physical network physnet1 to pool {{(pid=101898) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:17:14.655585 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-128585750'] for segment, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.844307 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: from cryptography.utils import int_from_bytes Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: from cryptography.utils import int_from_bytes Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: Traceback (most recent call last): Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: timer() Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: cb(*args, **kw) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: return func(*args, **kwargs) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: self._notify() Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: self.callback(batched_events) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: event.method(event) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: return f(self, *a, **k) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._get(url).json() Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: return self.request(url, 'GET', **kwargs) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:17:14.944684 dv-cinder-818037-1-iscsi neutron-server[101898]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:17:14.951112 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.023796 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.034391 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] 10.222.0.31 "DELETE /v2.0/networks/9e9bacc6-d435-4716-b3de-1d8db6721725 HTTP/1.1" status: 204 len: 168 time: 2.5766442 Nov 16 03:17:15.042518 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9bb821-2d22-4eb3-bac5-e2ca5ee7c37c admin admin] Pushing event deleted for resources: {'Network': ['ID=9e9bacc6-d435-4716-b3de-1d8db6721725,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:15.057041 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40618) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:15.096859 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port a9dd54a6-2e04-4400-93de-25f6cdedcfd0, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:15.109873 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.214701 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Deleting subnet 28b5baae-6fb4-47a0-9731-4c8618a4b142 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:17:15.225572 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Pushing event updated for resources: {'Port': ['ID=d7068ec0-21b9-465d-9309-774abd9482b7,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:15.230295 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.269172 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ff1d19-73e2-4983-a2ea-1414b7e7656d req-0e3ec900-4e23-40cf-9389-ba40852457e4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:15.287967 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-58ff1d19-73e2-4983-a2ea-1414b7e7656d req-0e3ec900-4e23-40cf-9389-ba40852457e4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 932 time: 0.8857253 Nov 16 03:17:15.338632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f7e69534-b12b-41e4-b78d-014ae8dee4db {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:15.349383 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:15.349639 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Attempting to bind port d7068ec0-21b9-465d-9309-774abd9482b7 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:17:15.349906 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Attempting to bind port d7068ec0-21b9-465d-9309-774abd9482b7 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'c87f961f-876c-4440-87a5-a87de8e1b0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:17:15.350280 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Attempting to bind port d7068ec0-21b9-465d-9309-774abd9482b7 on network f95bded8-2028-40ca-9071-70ff49c6a60c {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:15.368059 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3b4c0ccb-c0a0-4a49-9fb5-3140797fe206 service neutron] 10.222.0.31 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 2.1081595 Nov 16 03:17:15.372446 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.387315 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.483166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Port d7068ec0-21b9-465d-9309-774abd9482b7 on network f95bded8-2028-40ca-9071-70ff49c6a60c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:17:15.486881 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Attempting to bind port d7068ec0-21b9-465d-9309-774abd9482b7 on network f95bded8-2028-40ca-9071-70ff49c6a60c {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:15.509156 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Transition to ACTIVE for port object f7e69534-b12b-41e4-b78d-014ae8dee4db will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:17:15.550971 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.571580 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.698110 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 17, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:17:15.701777 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Checking segment: {'id': 'c87f961f-876c-4440-87a5-a87de8e1b0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:15.702971 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Bound using segment: {'id': 'c87f961f-876c-4440-87a5-a87de8e1b0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:17:15.705063 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Bound port: d7068ec0-21b9-465d-9309-774abd9482b7, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c87f961f-876c-4440-87a5-a87de8e1b0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:17:15.706937 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.746836 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.778432 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-58ff1d19-73e2-4983-a2ea-1414b7e7656d req-4afa93c0-94e8-412c-9a5e-50d31bab5986 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4893701 Nov 16 03:17:15.880693 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a9dd54a6-2e04-4400-93de-25f6cdedcfd0 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:15.895750 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Pushing event updated for resources: {'Port': ['ID=f7e69534-b12b-41e4-b78d-014ae8dee4db,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:15.958862 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:15.976793 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-55d2acc3-25c8-4007-9d6b-1fc2b14c0a18 service neutron] 10.222.0.31 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6071062 Nov 16 03:17:15.977349 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] 10.222.0.31 "DELETE /v2.0/subnets/28b5baae-6fb4-47a0-9731-4c8618a4b142 HTTP/1.1" status: 204 len: 168 time: 0.9180126 Nov 16 03:17:15.984340 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40638) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:16.007200 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:16.007578 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:16.016766 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff85fda5-98ba-45f8-99d9-429a97c6888e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=28b5baae-6fb4-47a0-9731-4c8618a4b142,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:16.240585 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:16.243212 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] For port d7068ec0-21b9-465d-9309-774abd9482b7, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:17:16.376921 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] For port d7068ec0-21b9-465d-9309-774abd9482b7, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d7068ec0-21b9-465d-9309-774abd9482b7,segment=NetworkSegment(c87f961f-876c-4440-87a5-a87de8e1b0b6),segment_id=c87f961f-876c-4440-87a5-a87de8e1b0b6)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:17:16.379920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Attempting to bind port f7e69534-b12b-41e4-b78d-014ae8dee4db on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:17:16.383055 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Attempting to bind port f7e69534-b12b-41e4-b78d-014ae8dee4db by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:17:16.385056 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Attempting to bind port f7e69534-b12b-41e4-b78d-014ae8dee4db on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:16.392471 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:16.443745 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb89992f-fb1b-449f-a107-adac9bd1b423 req-59cfa7c6-9f3d-440c-b064-726cfd1ed13a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:16.446188 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb89992f-fb1b-449f-a107-adac9bd1b423 req-59cfa7c6-9f3d-440c-b064-726cfd1ed13a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.5468957 Nov 16 03:17:16.517958 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-36be871c-2fb2-44e7-8717-6a26d4eaab2e req-c728cc17-e616-437a-9388-d1b24aa81d4f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 210 time: 0.1269677 Nov 16 03:17:16.532606 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Port f7e69534-b12b-41e4-b78d-014ae8dee4db on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:17:16.533161 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Attempting to bind port f7e69534-b12b-41e4-b78d-014ae8dee4db on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:16.659590 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:16.660970 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:16.664150 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] 10.222.0.11 "PUT /v2.0/ports/d7068ec0-21b9-465d-9309-774abd9482b7 HTTP/1.1" status: 200 len: 1094 time: 7.2666981 Nov 16 03:17:16.683594 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'tag': 'd7068ec0-21b9-465d-9309-774abd9482b7'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:16.751309 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:16.893196 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4b099bbb-f179-45d7-9de0-63a371065c00']}} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:16.948283 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4e7e9395-18af-4a5f-aec4-c471373c4dad') {'for_net_delete': True} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:16.949096 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4e7e9395-18af-4a5f-aec4-c471373c4dad') {} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:17:16.990955 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129419530'] for segment, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:17.053551 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:17.078239 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Releasing vlan 333 on physical network physnet1 to pool {{(pid=101898) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:17:17.079583 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-128585750'] for segment, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: Traceback (most recent call last): Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: timer() Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: cb(*args, **kw) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: return func(*args, **kwargs) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: self._notify() Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: self.callback(batched_events) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: event.method(event) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: return f(self, *a, **k) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._get(url).json() Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: return self.request(url, 'GET', **kwargs) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:17:17.092970 dv-cinder-818037-1-iscsi neutron-server[101898]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:17:17.139179 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 17, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:17:17.139549 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Checking segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:17.139955 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Bound using segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:17:17.140416 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Bound port: f7e69534-b12b-41e4-b78d-014ae8dee4db, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:17:17.140773 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:17.222864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:17.240142 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:17.247075 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4eb267f-89b3-49e0-8d66-84c935eb35d7 service neutron] Pushing event updated for resources: {'Port': ['ID=d7068ec0-21b9-465d-9309-774abd9482b7,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:17.252036 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] 10.222.0.31 "DELETE /v2.0/networks/4b099bbb-f179-45d7-9de0-63a371065c00 HTTP/1.1" status: 204 len: 168 time: 1.2594967 Nov 16 03:17:17.280072 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbe84c2-a8dc-45e4-a17c-45f9865738c3 admin admin] Pushing event deleted for resources: {'Network': ['ID=4b099bbb-f179-45d7-9de0-63a371065c00,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:17.516552 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb89992f-fb1b-449f-a107-adac9bd1b423 req-2dd12624-4ccc-42e4-8000-5902608979e6 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0201383 Nov 16 03:17:17.612975 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d07a34b3-c9c6-4f0d-85be-af14f762a48b" -d '{"events": [{"name": "network-changed", "server_uuid": "fd4c1d11-6671-41e6-aae2-b735518a3850", "tag": "d7068ec0-21b9-465d-9309-774abd9482b7"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:17.679647 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-6284b6d5-8b94-4280-a101-5268dd22ec8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:17.681592 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-6284b6d5-8b94-4280-a101-5268dd22ec8e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b9840e08acad4f96a65962ff11498530&device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 1097 time: 0.4582007 Nov 16 03:17:17.709775 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261a789c-2696-4b80-9db9-c11b2313b959 req-a6b9e59e-5e36-4976-be80-f2ab3e8b7dfd tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:17.719116 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-261a789c-2696-4b80-9db9-c11b2313b959 req-a6b9e59e-5e36-4976-be80-f2ab3e8b7dfd tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.5339947 Nov 16 03:17:17.787394 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40698) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:17.869328 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] For port f7e69534-b12b-41e4-b78d-014ae8dee4db, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:17:17.916455 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-261a789c-2696-4b80-9db9-c11b2313b959 req-0c949c04-6f11-486b-93eb-2fc479c5ea7e tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1940093 Nov 16 03:17:17.929531 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f1ad05c9-a078-4082-a941-d7231001b811 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=97e68b408d034c0c8857be85e3ca59f5&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1384883 Nov 16 03:17:17.932175 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40700) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:17.943803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] For port f7e69534-b12b-41e4-b78d-014ae8dee4db, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:17:17.967181 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.040590 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-440d01d6-31d2-41c7-818e-64adfef6d69e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.054849 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:18.056501 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.059969 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] 10.222.0.11 "PUT /v2.0/ports/f7e69534-b12b-41e4-b78d-014ae8dee4db HTTP/1.1" status: 200 len: 1094 time: 8.6610944 Nov 16 03:17:18.071764 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-440d01d6-31d2-41c7-818e-64adfef6d69e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.083764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-92817406-9005-4a23-87db-b8e6b0a137c8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:18.086623 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-92817406-9005-4a23-87db-b8e6b0a137c8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 819 time: 0.3532557 Nov 16 03:17:18.138641 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-40f9a87c-adbc-4ecc-9eee-0c65ccab3ca3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/quotas/e487df53678d4cd890ccf9e6c950fa5e HTTP/1.1" status: 200 len: 375 time: 0.0344622 Nov 16 03:17:18.142180 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4895ea74-4327-47db-933d-8aeed0573fec service neutron] Pushing event updated for resources: {'Port': ['ID=f7e69534-b12b-41e4-b78d-014ae8dee4db,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:18.176572 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-440d01d6-31d2-41c7-818e-64adfef6d69e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.184822 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-440d01d6-31d2-41c7-818e-64adfef6d69e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.188416 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-440d01d6-31d2-41c7-818e-64adfef6d69e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/aa55705c-d06e-4e97-a609-8c05f664dde3 HTTP/1.1" status: 204 len: 168 time: 0.2548001 Nov 16 03:17:18.206761 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-440d01d6-31d2-41c7-818e-64adfef6d69e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa55705c-d06e-4e97-a609-8c05f664dde3,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:18.255755 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-86e27d0f-a9c4-4c00-8289-2d6da53aad3c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1038542 Nov 16 03:17:18.359084 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70e81c74-df4a-44de-8666-e9247795461a x-openstack-request-id: req-70e81c74-df4a-44de-8666-e9247795461a {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:18.359687 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd4c1d11-6671-41e6-aae2-b735518a3850", "tag": "d7068ec0-21b9-465d-9309-774abd9482b7", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:18.360084 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-70e81c74-df4a-44de-8666-e9247795461a {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:18.360806 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'tag': 'd7068ec0-21b9-465d-9309-774abd9482b7', 'status': 'completed', 'code': 200} Nov 16 03:17:18.407279 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-dd9d29d4-c6bc-4207-a750-384581b94bd5 service neutron] 10.222.0.31 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1421702 Nov 16 03:17:18.439526 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2d520b2f-b415-4f4e-a8e6-0b30b79bd3ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.535617 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-f0a7dff0-2a8b-4d50-b9da-8f31ac6ec333 service neutron] 10.222.0.31 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1210320 Nov 16 03:17:18.687356 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40714) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:18.689482 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6017d9ff-54f9-4f17-ac41-6c7bf63ed5b4 req-cc1f217a-5c1a-45b5-8c65-15f2cd68310b tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:18.692231 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6017d9ff-54f9-4f17-ac41-6c7bf63ed5b4 req-cc1f217a-5c1a-45b5-8c65-15f2cd68310b tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.0892029 Nov 16 03:17:18.769481 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-272bb596-6b58-4dc1-b005-c598ab06a558 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cb501663d9634cfcbb8766c325f9229d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0783796 Nov 16 03:17:18.771286 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40720) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:18.822562 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b242be4c-4d1e-4ecd-8673-9ed80db929c4 req-c0a43b7e-e38d-4488-b8b1-b46d54e5c231 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 210 time: 0.0538685 Nov 16 03:17:18.828765 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6017d9ff-54f9-4f17-ac41-6c7bf63ed5b4 req-3c7da09e-afb6-41db-870d-4eb882aa9f69 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1300728 Nov 16 03:17:18.865599 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a2bcc66-b24b-4980-8159-12832574d69d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.900690 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a2bcc66-b24b-4980-8159-12832574d69d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.972233 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a2bcc66-b24b-4980-8159-12832574d69d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.975983 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a2bcc66-b24b-4980-8159-12832574d69d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:18.978475 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7a2bcc66-b24b-4980-8159-12832574d69d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f157a820-faf2-4ead-95b6-b4d72cf3e605 HTTP/1.1" status: 204 len: 168 time: 0.2054679 Nov 16 03:17:18.991036 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2bcc66-b24b-4980-8159-12832574d69d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f157a820-faf2-4ead-95b6-b4d72cf3e605,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:19.134571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3fb3ed0-75d7-4757-b731-fe6f673d4019 req-b2330953-b040-4e79-886d-5182cde55900 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:19.138639 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a3fb3ed0-75d7-4757-b731-fe6f673d4019 req-b2330953-b040-4e79-886d-5182cde55900 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.0842521 Nov 16 03:17:19.214281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a3fb3ed0-75d7-4757-b731-fe6f673d4019 req-bec351f1-a833-47d6-813b-ddc84d47a5a2 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685775 Nov 16 03:17:19.740991 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:19.987018 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9373fbf1-1412-4e58-b0fe-4d3418b58b80 req-87ef6224-cd84-4129-87a6-a207155dcbb3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 210 time: 0.0628583 Nov 16 03:17:20.046889 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7368ea4-4f7b-4c9e-9e37-41df23921877 req-786e245c-9f03-45b5-8fd4-f1be1b4b199e tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:20.050639 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7368ea4-4f7b-4c9e-9e37-41df23921877 req-786e245c-9f03-45b5-8fd4-f1be1b4b199e tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.1084981 Nov 16 03:17:20.156317 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7368ea4-4f7b-4c9e-9e37-41df23921877 req-5f438fd9-9253-4979-8a5f-b407f5560430 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842657 Nov 16 03:17:20.373502 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b88a542c-0928-49cd-81c8-e95440adc731', 'tag': 'f7e69534-b12b-41e4-b78d-014ae8dee4db'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:20.377831 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-141d4196-3017-4c3b-b846-29625566e7bc" -d '{"events": [{"name": "network-changed", "server_uuid": "b88a542c-0928-49cd-81c8-e95440adc731", "tag": "f7e69534-b12b-41e4-b78d-014ae8dee4db"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:20.428229 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c517b5f2-6658-4b66-b217-16dfc253ac85 req-19d18ec3-48f2-4197-a5cc-b79062258d81 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:20.431273 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c517b5f2-6658-4b66-b217-16dfc253ac85 req-19d18ec3-48f2-4197-a5cc-b79062258d81 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.1053393 Nov 16 03:17:20.510435 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c4011f2-832d-4d67-b023-178a5662a6ae x-openstack-request-id: req-4c4011f2-832d-4d67-b023-178a5662a6ae {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:20.510967 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b88a542c-0928-49cd-81c8-e95440adc731", "tag": "f7e69534-b12b-41e4-b78d-014ae8dee4db", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:20.511430 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-4c4011f2-832d-4d67-b023-178a5662a6ae {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:20.512097 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b88a542c-0928-49cd-81c8-e95440adc731', 'tag': 'f7e69534-b12b-41e4-b78d-014ae8dee4db', 'status': 'completed', 'code': 200} Nov 16 03:17:20.552828 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c517b5f2-6658-4b66-b217-16dfc253ac85 req-cb18c933-9f1e-4bf4-881d-8780e426097a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046033 Nov 16 03:17:21.175313 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46a1395d-2498-4d5d-8964-4be06590c117 req-7dcb3e69-b5bc-41c4-8a88-2362f5afe773 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 210 time: 0.0485590 Nov 16 03:17:21.522445 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:21.533839 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-60fdf048-5d3a-4e40-822d-c617cc2c9ea9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d7068ec0-21b9-465d-9309-774abd9482b7 HTTP/1.1" status: 200 len: 217 time: 0.2865024 Nov 16 03:17:21.604245 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:21.899233 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-141d4196-3017-4c3b-b846-29625566e7bc req-19ec9423-d83f-45da-82c3-3b02eabb0dd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:21.901927 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-141d4196-3017-4c3b-b846-29625566e7bc req-19ec9423-d83f-45da-82c3-3b02eabb0dd3 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 1097 time: 0.5137432 Nov 16 03:17:21.946250 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2ae86f5e-da61-44e8-87a3-8e2c0bca7848 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:21.949166 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2ae86f5e-da61-44e8-87a3-8e2c0bca7848 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=62a9a221-1e05-4212-8fa0-766d2a72e114 HTTP/1.1" status: 200 len: 851 time: 0.3239775 Nov 16 03:17:21.967256 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc038c0-49b1-4c55-8ac5-7425bcc86922 req-05d010e7-8448-49d0-9011-93fedaef07ae tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:21.974061 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40854) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:21.981902 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2fc038c0-49b1-4c55-8ac5-7425bcc86922 req-05d010e7-8448-49d0-9011-93fedaef07ae tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.4572847 Nov 16 03:17:22.352596 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703d377f-5a78-4421-8362-90fd1d71e516 req-a4e8c970-696a-4780-9e1a-2a428d91db38 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:22.354049 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5d41fda-9de0-429d-bf31-5fb958c55907 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.355799 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-703d377f-5a78-4421-8362-90fd1d71e516 req-a4e8c970-696a-4780-9e1a-2a428d91db38 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.5732119 Nov 16 03:17:22.418686 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2fd8064f-bdc3-4127-9000-f9790d1a2e07 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f95bded8-2028-40ca-9071-70ff49c6a60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4331210 Nov 16 03:17:22.473720 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.11', 53895) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:22.538630 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5d41fda-9de0-429d-bf31-5fb958c55907 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.547174 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5d41fda-9de0-429d-bf31-5fb958c55907 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.641747 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d5d41fda-9de0-429d-bf31-5fb958c55907 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8d77db84830a45eeae6d850a55bbff65&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6627851 Nov 16 03:17:22.642750 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d41fda-9de0-429d-bf31-5fb958c55907 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fbd3634-3ae0-412c-8c1a-c24a96d5f4af,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:22.646054 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40878) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:22.728972 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8c27b52b-cf3f-4b15-8be3-06c2548709c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.763636 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8c27b52b-cf3f-4b15-8be3-06c2548709c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.867507 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8c27b52b-cf3f-4b15-8be3-06c2548709c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.870500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8c27b52b-cf3f-4b15-8be3-06c2548709c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:22.875821 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8c27b52b-cf3f-4b15-8be3-06c2548709c5 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/8fbd3634-3ae0-412c-8c1a-c24a96d5f4af HTTP/1.1" status: 204 len: 168 time: 0.2279880 Nov 16 03:17:22.890414 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c27b52b-cf3f-4b15-8be3-06c2548709c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fbd3634-3ae0-412c-8c1a-c24a96d5f4af,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:23.164460 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.11', 53898) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:23.166276 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2fc038c0-49b1-4c55-8ac5-7425bcc86922 req-c1690c23-d119-4616-ae5a-1299773bff90 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.1829102 Nov 16 03:17:23.264979 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-703d377f-5a78-4421-8362-90fd1d71e516 req-afee078d-f07f-4ffe-806a-612295801c19 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8477967 Nov 16 03:17:23.268199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40902) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:23.280001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-141d4196-3017-4c3b-b846-29625566e7bc req-b87ca200-9e2f-40a6-a39c-e4bb081c74fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:23.299652 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-141d4196-3017-4c3b-b846-29625566e7bc req-b87ca200-9e2f-40a6-a39c-e4bb081c74fa service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&shared=False HTTP/1.1" status: 200 len: 915 time: 1.3665090 Nov 16 03:17:23.650860 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-ad7c84eb-7369-43f5-bae2-f944eb20e494 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:23.652864 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-ad7c84eb-7369-43f5-bae2-f944eb20e494 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 819 time: 0.4596837 Nov 16 03:17:23.679899 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Request body: {'port': {'device_id': '12b32c77-f241-4147-abf7-2b54d564588a', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'admin_state_up': True, 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:23.723140 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40920) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:23.741526 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bac69de7-2e43-49cc-8810-f22530f481e0 req-cf38d7d3-84d4-4d5d-aca2-322fd984dbea tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 210 time: 0.1630094 Nov 16 03:17:23.799746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-41bd2d5b-7421-4aa0-a09c-f9a2caf20ebb admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:23.836305 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-c6efd0fd-469b-4785-8d79-209a83a79b93 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:23.839225 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-c6efd0fd-469b-4785-8d79-209a83a79b93 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 819 time: 1.3397691 Nov 16 03:17:23.883734 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c329b632-1e58-4468-b389-57ef8c493f6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:23.901525 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-b7e0d39e-62b5-4cbe-95b5-8a7f6bbc2d53 service neutron] 10.222.0.11 "GET /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.4148831 Nov 16 03:17:23.918902 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Request body: {'port': {'device_id': '41418e21-082d-437e-acdd-7219a2790fcc', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'admin_state_up': True, 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:24.056856 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-141d4196-3017-4c3b-b846-29625566e7bc req-00d6e437-2688-45e2-8a2f-fc3ceda7d2ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:24.058615 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-141d4196-3017-4c3b-b846-29625566e7bc req-00d6e437-2688-45e2-8a2f-fc3ceda7d2ef service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.7551193 Nov 16 03:17:24.158827 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Made reservation on behalf of e487df53678d4cd890ccf9e6c950fa5e for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:24.165603 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:24.258845 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46bfbf8d-7bb4-4382-b89f-7436d2b13fe8 req-2b86d949-6500-499f-b03f-3d254913c916 service neutron] 10.222.0.11 "GET /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3296809 Nov 16 03:17:24.676667 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Allocated IP 172.20.0.6 (b8800875-2e98-4cb6-a3a9-9d5ee637458a/d29e78fd-50ef-4647-88a4-83b1f418a6b5/437cd5b7-c458-4185-9487-1110be169765) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:17:24.830427 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-e1b20d3c-1fd2-49be-b803-6c01dcdf8694 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:24.832971 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-e1b20d3c-1fd2-49be-b803-6c01dcdf8694 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 1097 time: 0.4612470 Nov 16 03:17:24.841814 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-41bd2d5b-7421-4aa0-a09c-f9a2caf20ebb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:24.853656 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Made reservation on behalf of e487df53678d4cd890ccf9e6c950fa5e for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:24.859545 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:24.886851 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-0b7032da-af74-4aa7-9db7-9508f8c4a546 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:24.896471 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-0b7032da-af74-4aa7-9db7-9508f8c4a546 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b9840e08acad4f96a65962ff11498530&device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 1097 time: 0.4867005 Nov 16 03:17:24.939274 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-41bd2d5b-7421-4aa0-a09c-f9a2caf20ebb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:24.962067 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a47dc98-210c-402e-8804-aff713c331e1 req-bc3be2b4-9cad-4365-80b4-3c1538bb6771 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:24.964805 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9a47dc98-210c-402e-8804-aff713c331e1 req-bc3be2b4-9cad-4365-80b4-3c1538bb6771 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.4639733 Nov 16 03:17:24.993579 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4d70ba-fb40-4be3-9220-f1eb77a34156 req-09a05303-4d7d-49cc-8eae-f0498eff7b1a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:25.014143 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cf4d70ba-fb40-4be3-9220-f1eb77a34156 req-09a05303-4d7d-49cc-8eae-f0498eff7b1a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.4960515 Nov 16 03:17:25.056149 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.146086 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-d81e13dd-0339-495c-a371-01acc47664fe service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db HTTP/1.1" status: 200 len: 217 time: 0.2823081 Nov 16 03:17:25.152079 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.324500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:17:25.331745 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Pushing event updated for resources: {'Port': ['ID=437cd5b7-c458-4185-9487-1110be169765,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:25.335566 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:25.339723 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:17:25.356457 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c329b632-1e58-4468-b389-57ef8c493f6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.430838 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:25.431879 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.446217 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-41bd2d5b-7421-4aa0-a09c-f9a2caf20ebb admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ab22b9d09ed14f7e8b926f320a972894&name=default HTTP/1.1" status: 200 len: 2996 time: 2.1673517 Nov 16 03:17:25.447224 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c329b632-1e58-4468-b389-57ef8c493f6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.450666 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40972) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:25.497554 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-697c6dd2-fdb7-4873-ad50-94d8510f476d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8230994 Nov 16 03:17:25.506539 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41bd2d5b-7421-4aa0-a09c-f9a2caf20ebb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=454f631a-e8d2-4277-b3b6-97c067893519,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:25.548422 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-047ef848-df88-455c-ae98-371c7359edd5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.588367 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-047ef848-df88-455c-ae98-371c7359edd5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.615955 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40980) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:25.690222 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-047ef848-df88-455c-ae98-371c7359edd5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.695962 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-047ef848-df88-455c-ae98-371c7359edd5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.698003 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-047ef848-df88-455c-ae98-371c7359edd5 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/454f631a-e8d2-4277-b3b6-97c067893519 HTTP/1.1" status: 204 len: 168 time: 0.2456300 Nov 16 03:17:25.714203 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-047ef848-df88-455c-ae98-371c7359edd5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=454f631a-e8d2-4277-b3b6-97c067893519,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:25.770779 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cf4d70ba-fb40-4be3-9220-f1eb77a34156 req-719d5c44-dcc8-4090-aacb-563a045c2c80 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7555375 Nov 16 03:17:25.827643 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-fbfd3eea-454c-485a-9f79-7b0f667d8a4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:25.830789 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-fbfd3eea-454c-485a-9f79-7b0f667d8a4b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.6580894 Nov 16 03:17:25.840814 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-c329b632-1e58-4468-b389-57ef8c493f6e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=2bae430a28b74b6dbffdcf822d14ffc5&name=default HTTP/1.1" status: 200 len: 2996 time: 2.1012750 Nov 16 03:17:25.852626 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40988) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:25.876639 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7084f091-957f-4518-90ea-b768a70c0790 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:25.906579 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c329b632-1e58-4468-b389-57ef8c493f6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f5b40b8-e81b-40e2-b9bc-fb4e0b6c56fe,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:25.927985 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-eb9602ff-efbe-4654-8b2f-2d83a6a94dd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:25.930274 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-eb9602ff-efbe-4654-8b2f-2d83a6a94dd9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f95bded8-2028-40ca-9071-70ff49c6a60c HTTP/1.1" status: 200 len: 912 time: 1.0312803 Nov 16 03:17:25.952051 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9a47dc98-210c-402e-8804-aff713c331e1 req-068146df-34a4-4766-b62e-674d709dacf4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8772483 Nov 16 03:17:26.016873 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Allocated IP 172.20.0.11 (b8800875-2e98-4cb6-a3a9-9d5ee637458a/d29e78fd-50ef-4647-88a4-83b1f418a6b5/c7ca7b87-66b6-45ce-9656-e62a40792408) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:17:26.020537 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-58de6422-a4ac-49a3-a26b-6ad5c3c7525c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.088058 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-58de6422-a4ac-49a3-a26b-6ad5c3c7525c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.089143 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66907a28-c6dd-4f78-8286-30e1c61d9c73 req-99e6183c-e0b7-4e26-83f8-214c1ea64c22 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:26.099983 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-66907a28-c6dd-4f78-8286-30e1c61d9c73 req-99e6183c-e0b7-4e26-83f8-214c1ea64c22 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 931 time: 0.1841924 Nov 16 03:17:26.176019 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7084f091-957f-4518-90ea-b768a70c0790 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.185812 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7084f091-957f-4518-90ea-b768a70c0790 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.242015 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7084f091-957f-4518-90ea-b768a70c0790 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58604c62-a510-45b5-86ee-48450fe4c68e,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:26.282404 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7084f091-957f-4518-90ea-b768a70c0790 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c22a86d172c84517b5f8528001888380&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6646111 Nov 16 03:17:26.285254 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 40992) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:26.312198 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-66907a28-c6dd-4f78-8286-30e1c61d9c73 req-d6a8d698-2618-4f39-85eb-701792d8dab6 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2005227 Nov 16 03:17:26.340587 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-58de6422-a4ac-49a3-a26b-6ad5c3c7525c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.345910 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-58de6422-a4ac-49a3-a26b-6ad5c3c7525c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.348270 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-58de6422-a4ac-49a3-a26b-6ad5c3c7525c admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/0f5b40b8-e81b-40e2-b9bc-fb4e0b6c56fe HTTP/1.1" status: 204 len: 168 time: 0.4927166 Nov 16 03:17:26.397380 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 40998) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:26.398532 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58de6422-a4ac-49a3-a26b-6ad5c3c7525c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f5b40b8-e81b-40e2-b9bc-fb4e0b6c56fe,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:26.443425 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b648cfec-30f6-4ffd-ae3b-8cdb3286325a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.455285 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.458646 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e16e274-5287-4bf2-a766-09b8b16abd74 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.520680 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e16e274-5287-4bf2-a766-09b8b16abd74 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.598035 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.635463 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e16e274-5287-4bf2-a766-09b8b16abd74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.639122 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e16e274-5287-4bf2-a766-09b8b16abd74 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.640974 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-6e16e274-5287-4bf2-a766-09b8b16abd74 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/58604c62-a510-45b5-86ee-48450fe4c68e HTTP/1.1" status: 204 len: 168 time: 0.3448267 Nov 16 03:17:26.667199 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e16e274-5287-4bf2-a766-09b8b16abd74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58604c62-a510-45b5-86ee-48450fe4c68e,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:26.689069 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Network b8800875-2e98-4cb6-a3a9-9d5ee637458a is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:17:26.700414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:26.722558 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:17:26.732415 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:26.733524 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.756251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b648cfec-30f6-4ffd-ae3b-8cdb3286325a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.764207 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Pushing event updated for resources: {'Port': ['ID=c7ca7b87-66b6-45ce-9656-e62a40792408,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:26.773968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b648cfec-30f6-4ffd-ae3b-8cdb3286325a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.820959 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-24a8d001-49c4-498c-9b3d-5df8f7f7b6b8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.9340792 Nov 16 03:17:26.858934 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b648cfec-30f6-4ffd-ae3b-8cdb3286325a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6d29c616a2174f3497a98ecf14f427ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4595981 Nov 16 03:17:26.860860 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b648cfec-30f6-4ffd-ae3b-8cdb3286325a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16bfe260-4094-46fb-9cff-cb7ff2144bfd,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:26.862033 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41008) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:26.964692 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b941b08-b1fa-42ab-a00a-38587274045b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:26.999539 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b941b08-b1fa-42ab-a00a-38587274045b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.067010 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b941b08-b1fa-42ab-a00a-38587274045b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.067888 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b5d96-fbd9-4057-a246-7c4f0d8ea3fc req-ad0b9c0a-2799-4add-bf7d-cc573466462d tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:27.069861 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bb2b5d96-fbd9-4057-a246-7c4f0d8ea3fc req-ad0b9c0a-2799-4add-bf7d-cc573466462d tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.0991518 Nov 16 03:17:27.071235 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b941b08-b1fa-42ab-a00a-38587274045b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.072422 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3b941b08-b1fa-42ab-a00a-38587274045b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/16bfe260-4094-46fb-9cff-cb7ff2144bfd HTTP/1.1" status: 204 len: 168 time: 0.2094085 Nov 16 03:17:27.083093 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b941b08-b1fa-42ab-a00a-38587274045b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16bfe260-4094-46fb-9cff-cb7ff2144bfd,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:27.198463 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41020) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:27.220324 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-92b330a0-afbb-4e48-90af-ac04cc420c9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.373795 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bb2b5d96-fbd9-4057-a246-7c4f0d8ea3fc req-15e774d3-6a02-4112-aa2a-6f57d8a5eea3 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2856944 Nov 16 03:17:27.413121 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-92b330a0-afbb-4e48-90af-ac04cc420c9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.432097 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-92b330a0-afbb-4e48-90af-ac04cc420c9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.433460 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee06c08-8e66-49b0-a00e-6f080f99d387 req-8d367de7-273b-49a2-8864-ac40384e4f77 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:27.443338 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4ee06c08-8e66-49b0-a00e-6f080f99d387 req-8d367de7-273b-49a2-8864-ac40384e4f77 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.0730932 Nov 16 03:17:27.468953 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-92b330a0-afbb-4e48-90af-ac04cc420c9e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=64648c2b44cd4cb6a14f0a1313bb2343&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2690790 Nov 16 03:17:27.469467 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41032) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:27.499388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92b330a0-afbb-4e48-90af-ac04cc420c9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83cf99d5-9487-4e30-ba17-2aa9949668a8,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:27.577914 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4ee06c08-8e66-49b0-a00e-6f080f99d387 req-d892480c-9221-4fec-b944-339350307bf9 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1341126 Nov 16 03:17:27.605569 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ad006bd9-dbcd-4ec5-ae68-b213585e788e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.614348 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378286ba-3cab-4aef-ae5e-5813872e279a req-26ca99e3-ec9d-47f7-8333-4918f554ef8d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:27.616083 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-378286ba-3cab-4aef-ae5e-5813872e279a req-26ca99e3-ec9d-47f7-8333-4918f554ef8d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 931 time: 0.1293011 Nov 16 03:17:27.655992 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ad006bd9-dbcd-4ec5-ae68-b213585e788e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.731741 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-378286ba-3cab-4aef-ae5e-5813872e279a req-9e536ee3-2394-4d1e-8c67-7215077f460b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042230 Nov 16 03:17:27.804329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ad006bd9-dbcd-4ec5-ae68-b213585e788e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.809586 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ad006bd9-dbcd-4ec5-ae68-b213585e788e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:27.812156 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ad006bd9-dbcd-4ec5-ae68-b213585e788e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/83cf99d5-9487-4e30-ba17-2aa9949668a8 HTTP/1.1" status: 204 len: 168 time: 0.3413041 Nov 16 03:17:27.829913 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad006bd9-dbcd-4ec5-ae68-b213585e788e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83cf99d5-9487-4e30-ba17-2aa9949668a8,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:27.912828 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Request body: {'port': {'device_id': '12b32c77-f241-4147-abf7-2b54d564588a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:27.923413 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d7068ec0-21b9-465d-9309-774abd9482b7 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:17:27.951256 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Request body: {'port': {'device_id': '41418e21-082d-437e-acdd-7219a2790fcc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:28.123514 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-60977b4b-20ce-4d26-a8d8-a5ddde045a10 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2355292 Nov 16 03:17:28.129923 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-a0ec4003-c6f5-4d3f-ac06-15ce0345e593 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d7068ec0-21b9-465d-9309-774abd9482b7 HTTP/1.1" status: 200 len: 217 time: 0.1752107 Nov 16 03:17:28.172677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:28.328961 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-097644b2-b3f3-4ff5-b6d2-269da27809d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:28.332184 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-097644b2-b3f3-4ff5-b6d2-269da27809d7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=62a9a221-1e05-4212-8fa0-766d2a72e114 HTTP/1.1" status: 200 len: 851 time: 0.1844206 Nov 16 03:17:28.377485 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d7068ec0-21b9-465d-9309-774abd9482b7, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d7068ec0-21b9-465d-9309-774abd9482b7,segment=NetworkSegment(c87f961f-876c-4440-87a5-a87de8e1b0b6),segment_id=c87f961f-876c-4440-87a5-a87de8e1b0b6)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:28.452992 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'd7068ec0-21b9-465d-9309-774abd9482b7', 'network_id': 'f95bded8-2028-40ca-9071-70ff49c6a60c', 'port_id': 'd7068ec0-21b9-465d-9309-774abd9482b7', 'mac_address': 'fa:16:3e:df:80:38', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 321, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62a9a221-1e05-4212-8fa0-766d2a72e114', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:17:28.478248 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-80e63f7c-78a2-4ed3-bd2e-57bf22756901 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f95bded8-2028-40ca-9071-70ff49c6a60c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1030722 Nov 16 03:17:28.545673 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:28.586633 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:28.626157 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7068ec0-21b9-465d-9309-774abd9482b7 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:28.747478 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d7068ec0-21b9-465d-9309-774abd9482b7, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d7068ec0-21b9-465d-9309-774abd9482b7,segment=NetworkSegment(c87f961f-876c-4440-87a5-a87de8e1b0b6),segment_id=c87f961f-876c-4440-87a5-a87de8e1b0b6)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:28.767779 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:28.803473 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-04e786a5-9842-404a-809f-ac90d61ec2d9 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6708975 Nov 16 03:17:28.968835 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=d7068ec0-21b9-465d-9309-774abd9482b7,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:29.115073 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['d7068ec0-21b9-465d-9309-774abd9482b7'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:17:29.182213 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 437cd5b7-c458-4185-9487-1110be169765 {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:29.202448 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:29.271060 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Transition to ACTIVE for port object 437cd5b7-c458-4185-9487-1110be169765 will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:17:29.279130 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:29.282051 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a632df22-bbec-4f55-8dbc-f33377faad47 req-9e992ceb-1a44-444c-a7f8-267bb71c39f2 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4367743 Nov 16 03:17:29.554660 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fd4a90-806f-483e-bc8b-be63cd5257af req-caf37eea-5612-406f-806f-3d899ba37e70 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:29.567905 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-10fd4a90-806f-483e-bc8b-be63cd5257af req-caf37eea-5612-406f-806f-3d899ba37e70 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 944 time: 0.9049113 Nov 16 03:17:29.615069 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da16d006-8cf3-467f-b7d2-1b92a24d1836 req-518ed178-7d8b-4f5a-bb51-6c0729d8da37 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:29.624178 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da16d006-8cf3-467f-b7d2-1b92a24d1836 req-518ed178-7d8b-4f5a-bb51-6c0729d8da37 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.7936485 Nov 16 03:17:29.627646 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-0dd2b06d-a5c2-40dd-a144-80b96f9ef8c2 service neutron] 10.222.0.11 "GET /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1396241 Nov 16 03:17:29.830402 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Attempting to bind port 437cd5b7-c458-4185-9487-1110be169765 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:17:29.831188 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Attempting to bind port 437cd5b7-c458-4185-9487-1110be169765 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:17:29.831634 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Attempting to bind port 437cd5b7-c458-4185-9487-1110be169765 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:29.835241 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Pushing event updated for resources: {'Port': ['ID=437cd5b7-c458-4185-9487-1110be169765,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:29.842617 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Port 437cd5b7-c458-4185-9487-1110be169765 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:17:29.843334 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Attempting to bind port 437cd5b7-c458-4185-9487-1110be169765 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:29.852131 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 17, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:17:29.852779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Checking segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:29.853751 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Bound using segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:17:29.854514 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Bound port: 437cd5b7-c458-4185-9487-1110be169765, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:17:29.855118 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:29.981775 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] For port 437cd5b7-c458-4185-9487-1110be169765, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:17:29.983525 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-10fd4a90-806f-483e-bc8b-be63cd5257af req-bc17bb81-f668-4489-ab87-8ff07a93d8fe tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4143925 Nov 16 03:17:29.995317 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] For port 437cd5b7-c458-4185-9487-1110be169765, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=437cd5b7-c458-4185-9487-1110be169765,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:17:30.007393 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.010672 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da16d006-8cf3-467f-b7d2-1b92a24d1836 req-4d2b58dd-ce1b-4571-90bd-a710e22e6aff tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3855593 Nov 16 03:17:30.022484 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07a34b3-c9c6-4f0d-85be-af14f762a48b req-836d2616-a926-44ef-a479-6f4055d004a7 service neutron] 10.222.0.11 "GET /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3785882 Nov 16 03:17:30.149566 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:30.150196 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.151847 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] 10.222.0.11 "PUT /v2.0/ports/437cd5b7-c458-4185-9487-1110be169765 HTTP/1.1" status: 200 len: 1093 time: 2.2661242 Nov 16 03:17:30.152337 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '12b32c77-f241-4147-abf7-2b54d564588a', 'tag': '437cd5b7-c458-4185-9487-1110be169765'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:30.184494 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43bec90b-642b-49f8-a906-2a3bfa29e37f service neutron] Pushing event updated for resources: {'Port': ['ID=437cd5b7-c458-4185-9487-1110be169765,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:30.249465 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c7ca7b87-66b6-45ce-9656-e62a40792408 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:30.262053 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.297793 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5675eb-bd9a-4fe4-bd69-307514b6c65d req-f60a650b-2073-461e-9f19-7bc58a57f3a8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:30.299609 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b5675eb-bd9a-4fe4-bd69-307514b6c65d req-f60a650b-2073-461e-9f19-7bc58a57f3a8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 943 time: 0.1678941 Nov 16 03:17:30.317159 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Transition to ACTIVE for port object c7ca7b87-66b6-45ce-9656-e62a40792408 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:17:30.337604 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-9675087f-f340-4b1c-9b32-dafc80f64907 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:30.340851 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-9675087f-f340-4b1c-9b32-dafc80f64907 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 1096 time: 0.1145334 Nov 16 03:17:30.345780 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.431406 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-320a8b6c-b80b-4973-9e75-1cdd14669dc5" -d '{"events": [{"name": "network-changed", "server_uuid": "12b32c77-f241-4147-abf7-2b54d564588a", "tag": "437cd5b7-c458-4185-9487-1110be169765"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:30.443419 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-655cd145-3215-4a1b-b8c2-3ba2873e4fa0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=437cd5b7-c458-4185-9487-1110be169765 HTTP/1.1" status: 200 len: 217 time: 0.0883904 Nov 16 03:17:30.471249 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b5675eb-bd9a-4fe4-bd69-307514b6c65d req-33dcc9db-0ab3-42c7-91cb-1100f0b2ccc3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1648526 Nov 16 03:17:30.489380 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Pushing event updated for resources: {'Port': ['ID=c7ca7b87-66b6-45ce-9656-e62a40792408,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:30.527230 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Attempting to bind port c7ca7b87-66b6-45ce-9656-e62a40792408 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:17:30.527575 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Attempting to bind port c7ca7b87-66b6-45ce-9656-e62a40792408 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:17:30.527893 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Attempting to bind port c7ca7b87-66b6-45ce-9656-e62a40792408 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:30.534489 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Port c7ca7b87-66b6-45ce-9656-e62a40792408 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:17:30.534819 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Attempting to bind port c7ca7b87-66b6-45ce-9656-e62a40792408 on network b8800875-2e98-4cb6-a3a9-9d5ee637458a {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:17:30.541206 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 17, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:17:30.541580 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Checking segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:30.542026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Bound using segment: {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:17:30.542537 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Bound port: c7ca7b87-66b6-45ce-9656-e62a40792408, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd61b296a-1685-4eef-8945-c92743196c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 331, 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:17:30.542951 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.581879 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0d2fa-c507-46e6-a189-591c664b79be req-bae4f394-96e3-4029-8577-925746f140b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:30.586669 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-bae4f394-96e3-4029-8577-925746f140b2 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.1356878 Nov 16 03:17:30.658527 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-040cf9f9-3522-4898-ba5c-348dd363e9d8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0638020 Nov 16 03:17:30.659667 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] For port c7ca7b87-66b6-45ce-9656-e62a40792408, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:17:30.667640 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] For port c7ca7b87-66b6-45ce-9656-e62a40792408, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c7ca7b87-66b6-45ce-9656-e62a40792408,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:17:30.676445 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.725044 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:30.725843 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:30.727492 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] 10.222.0.11 "PUT /v2.0/ports/c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 1094 time: 2.7952001 Nov 16 03:17:30.727987 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41418e21-082d-437e-acdd-7219a2790fcc', 'tag': 'c7ca7b87-66b6-45ce-9656-e62a40792408'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:30.730552 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20ea7087-e697-49e7-968c-7e6bd035b25f" -d '{"events": [{"name": "network-changed", "server_uuid": "41418e21-082d-437e-acdd-7219a2790fcc", "tag": "c7ca7b87-66b6-45ce-9656-e62a40792408"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:30.797013 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3513484f-7d4c-42c8-8eea-15cf340a3dc9 service neutron] Pushing event updated for resources: {'Port': ['ID=c7ca7b87-66b6-45ce-9656-e62a40792408,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:30.867951 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9b9d185-01c3-4484-b68a-f40b96d75c7a x-openstack-request-id: req-d9b9d185-01c3-4484-b68a-f40b96d75c7a {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:30.868257 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41418e21-082d-437e-acdd-7219a2790fcc", "tag": "c7ca7b87-66b6-45ce-9656-e62a40792408", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:30.868542 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-d9b9d185-01c3-4484-b68a-f40b96d75c7a {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:30.869000 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41418e21-082d-437e-acdd-7219a2790fcc', 'tag': 'c7ca7b87-66b6-45ce-9656-e62a40792408', 'status': 'completed', 'code': 200} Nov 16 03:17:30.896652 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-92b97c41-6d98-4e40-ba9c-35e860b82e08 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2275295 Nov 16 03:17:30.906196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-db5357d1-9733-4365-a929-131fa3af274e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:30.907962 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-db5357d1-9733-4365-a929-131fa3af274e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1097 time: 0.0995905 Nov 16 03:17:30.909970 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c60c781-a692-40d1-b179-295826ddd129 x-openstack-request-id: req-5c60c781-a692-40d1-b179-295826ddd129 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:30.910188 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "12b32c77-f241-4147-abf7-2b54d564588a", "tag": "437cd5b7-c458-4185-9487-1110be169765", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:30.910440 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-5c60c781-a692-40d1-b179-295826ddd129 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:30.911030 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '12b32c77-f241-4147-abf7-2b54d564588a', 'tag': '437cd5b7-c458-4185-9487-1110be169765', 'status': 'completed', 'code': 200} Nov 16 03:17:31.013704 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-6a9de4b9-3442-45c8-89a3-00176b76385b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.0773411 Nov 16 03:17:31.057226 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-68e0d2fa-c507-46e6-a189-591c664b79be req-2ecc6323-bcb8-4174-93fb-f36a97b50b9a service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1502903 Nov 16 03:17:31.238204 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-6c8d3c7b-55f1-4d04-ae18-193823ee6fe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:31.241494 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-6c8d3c7b-55f1-4d04-ae18-193823ee6fe3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.2198322 Nov 16 03:17:31.337399 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-577ee61f-be48-4838-a5ce-864ee86b4f8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:31.344995 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-577ee61f-be48-4838-a5ce-864ee86b4f8b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 1096 time: 0.1764319 Nov 16 03:17:31.449470 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-963a092c-efbb-467e-b952-2d4cddf02869 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1989543 Nov 16 03:17:31.701581 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-53e1e9e9-aaef-4acc-881b-95466ba0ac06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:31.704487 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-53e1e9e9-aaef-4acc-881b-95466ba0ac06 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.3521502 Nov 16 03:17:31.734645 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a21825-3928-4b3e-81f2-4489be3f594c req-aa84f90a-be00-4ea3-8ee2-17a2d992563f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:31.744841 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-10a21825-3928-4b3e-81f2-4489be3f594c req-aa84f90a-be00-4ea3-8ee2-17a2d992563f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 944 time: 0.4164724 Nov 16 03:17:31.813679 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866f6d8b-d689-496e-9174-fbfce0eb40b1 req-67ea491a-5503-44c2-b99a-efed47c8ca5c tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:31.818528 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-977942b4-9f4e-4356-8ce0-992416f8b114 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=437cd5b7-c458-4185-9487-1110be169765 HTTP/1.1" status: 200 len: 217 time: 0.1054785 Nov 16 03:17:31.822273 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-866f6d8b-d689-496e-9174-fbfce0eb40b1 req-67ea491a-5503-44c2-b99a-efed47c8ca5c tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 945 time: 0.5495577 Nov 16 03:17:31.861701 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-1d9d1811-8bc6-442d-8f17-6cfa11efc1f8 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4001634 Nov 16 03:17:31.881632 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device f7e69534-b12b-41e4-b78d-014ae8dee4db details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:17:31.905705 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d7068ec0-21b9-465d-9309-774abd9482b7 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:31.993015 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-603932c9-d7e3-4874-8a84-0735530a8139 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:32.008489 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-603932c9-d7e3-4874-8a84-0735530a8139 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.1808236 Nov 16 03:17:32.091697 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-ebc1ff35-d9b3-45c3-b736-b7c4a7cdb639 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0747781 Nov 16 03:17:32.328889 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port d7068ec0-21b9-465d-9309-774abd9482b7 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:17:32.341867 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-c83fc50f-6e52-44fc-95a1-f29813ef130d service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2407928 Nov 16 03:17:32.377712 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port d7068ec0-21b9-465d-9309-774abd9482b7 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:32.381801 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:32.411952 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6c145894-2292-40a0-9f72-17b28bd1b6d1 req-4420b6d1-bac1-45b8-8c6b-cc5dec1723d4 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5055456 Nov 16 03:17:32.520560 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-866f6d8b-d689-496e-9174-fbfce0eb40b1 req-ff07a4e9-cd15-456e-9b22-3ef7557ae803 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6623261 Nov 16 03:17:32.545155 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-10a21825-3928-4b3e-81f2-4489be3f594c req-82c20992-9123-4cbc-9e26-2b7b99200883 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7985687 Nov 16 03:17:32.548014 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port f7e69534-b12b-41e4-b78d-014ae8dee4db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:32.606847 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'f7e69534-b12b-41e4-b78d-014ae8dee4db', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'port_id': 'f7e69534-b12b-41e4-b78d-014ae8dee4db', 'mac_address': 'fa:16:3e:0e:17:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 327, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3fb04df-83c0-4d51-afa7-1e0694c8dbc3', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:17:32.700792 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-320a8b6c-b80b-4973-9e75-1cdd14669dc5 req-38dca556-a42e-47ed-8405-005db5ba1a2e service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3437576 Nov 16 03:17:32.738552 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:32.768373 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f7e69534-b12b-41e4-b78d-014ae8dee4db {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:32.813701 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port f7e69534-b12b-41e4-b78d-014ae8dee4db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:32.825145 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-f077c898-a0f6-42f2-8f64-34e034516df8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:32.829226 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:32.835645 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:32.842306 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-f077c898-a0f6-42f2-8f64-34e034516df8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1097 time: 0.2958057 Nov 16 03:17:32.958008 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d7068ec0-21b9-465d-9309-774abd9482b7, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d7068ec0-21b9-465d-9309-774abd9482b7,segment=NetworkSegment(c87f961f-876c-4440-87a5-a87de8e1b0b6),segment_id=c87f961f-876c-4440-87a5-a87de8e1b0b6)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:32.968815 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7068ec0-21b9-465d-9309-774abd9482b7'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:33.082305 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99990808-1b9d-47a7-abb0-98b9d88f05b6 req-4e707d4d-8ca5-47e1-a008-3633405b9faf tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:33.087607 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-99990808-1b9d-47a7-abb0-98b9d88f05b6 req-4e707d4d-8ca5-47e1-a008-3633405b9faf tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 943 time: 0.4385784 Nov 16 03:17:33.265556 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:33.269839 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-99990808-1b9d-47a7-abb0-98b9d88f05b6 req-7c517529-2fc8-4cad-aa69-246a98c1f56e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1685367 Nov 16 03:17:33.277166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-51a5f054-db70-4fbc-8b8c-a0e04d7caa52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:33.279656 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-51a5f054-db70-4fbc-8b8c-a0e04d7caa52 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.4164662 Nov 16 03:17:33.312643 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=f7e69534-b12b-41e4-b78d-014ae8dee4db,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:33.342440 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-69950279-9c4d-49df-a5e4-6570630b1b94 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.0536907 Nov 16 03:17:33.381117 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:17:33.480157 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-95c5a844-1c47-402c-9312-350f23fd0ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:33.485987 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-95c5a844-1c47-402c-9312-350f23fd0ca4 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.1354728 Nov 16 03:17:33.489472 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=d7068ec0-21b9-465d-9309-774abd9482b7,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:33.559191 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-600d4bf8-684f-427b-86f6-f87a393d2824" -d '{"events": [{"server_uuid": "fd4c1d11-6671-41e6-aae2-b735518a3850", "name": "network-vif-plugged", "status": "completed", "tag": "d7068ec0-21b9-465d-9309-774abd9482b7"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:33.566304 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-82e15efe-9045-4ea6-80a8-d1eb2d8bf6a4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0701349 Nov 16 03:17:33.832950 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-eca2bbd2-7a77-4235-b28e-51d8e6c660c5 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2592800 Nov 16 03:17:33.841548 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8922f9e8-ac98-4025-9ba7-b6f1f8f3815e req-6fbaa43a-14c7-4a6a-ba30-4b3bd2005042 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:33.843193 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8922f9e8-ac98-4025-9ba7-b6f1f8f3815e req-6fbaa43a-14c7-4a6a-ba30-4b3bd2005042 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.1399882 Nov 16 03:17:33.900894 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 437cd5b7-c458-4185-9487-1110be169765 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:17:33.956193 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8922f9e8-ac98-4025-9ba7-b6f1f8f3815e req-cfc93c1a-90ec-4102-a52d-749bde50c07b tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034837 Nov 16 03:17:34.003642 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-20ea7087-e697-49e7-968c-7e6bd035b25f req-6d01390c-a614-4158-b5f7-5d364fc52331 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1591482 Nov 16 03:17:34.096949 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd429a4-6ceb-4ff8-a444-c6715fb5cb93 req-55f27deb-b158-49d4-9155-025b772afee6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:34.105473 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2cd429a4-6ceb-4ff8-a444-c6715fb5cb93 req-55f27deb-b158-49d4-9155-025b772afee6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 945 time: 0.0623283 Nov 16 03:17:34.144889 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4d57668-9332-46aa-bdf8-3f18344b1da0 x-openstack-request-id: req-e4d57668-9332-46aa-bdf8-3f18344b1da0 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:34.146185 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd4c1d11-6671-41e6-aae2-b735518a3850", "name": "network-vif-plugged", "status": "completed", "tag": "d7068ec0-21b9-465d-9309-774abd9482b7", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:34.146722 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-e4d57668-9332-46aa-bdf8-3f18344b1da0 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:34.147374 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7068ec0-21b9-465d-9309-774abd9482b7', 'code': 200} Nov 16 03:17:34.154295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 437cd5b7-c458-4185-9487-1110be169765, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=437cd5b7-c458-4185-9487-1110be169765,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:34.166154 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2cd429a4-6ceb-4ff8-a444-c6715fb5cb93 req-dc28b450-61fd-4189-8332-5920544472f6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596452 Nov 16 03:17:34.169420 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '437cd5b7-c458-4185-9487-1110be169765', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'port_id': '437cd5b7-c458-4185-9487-1110be169765', 'mac_address': 'fa:16:3e:37:3a:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 331, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:17:34.222373 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:34.238320 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 437cd5b7-c458-4185-9487-1110be169765 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:34.263972 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 437cd5b7-c458-4185-9487-1110be169765, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=437cd5b7-c458-4185-9487-1110be169765,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:34.271018 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:34.400871 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=437cd5b7-c458-4185-9487-1110be169765,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:34.462523 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e5b000-d917-4a11-9706-856740c4be1c req-efb735cc-1044-4c54-9c9b-3ccefceac550 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:34.470972 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44e5b000-d917-4a11-9706-856740c4be1c req-efb735cc-1044-4c54-9c9b-3ccefceac550 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 944 time: 0.0869944 Nov 16 03:17:34.576688 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['437cd5b7-c458-4185-9487-1110be169765'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:17:34.582220 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2044d8-e845-4df6-af19-5c05415543c2 req-aa33fe58-1cb1-4c14-8aa4-b0b072a42419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:34.582220 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9b2044d8-e845-4df6-af19-5c05415543c2 req-aa33fe58-1cb1-4c14-8aa4-b0b072a42419 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 1099 time: 0.1337218 Nov 16 03:17:34.596509 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44e5b000-d917-4a11-9706-856740c4be1c req-5a0f8f75-ad1f-4f02-b242-284ed1481ce9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233516 Nov 16 03:17:34.615968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9b2044d8-e845-4df6-af19-5c05415543c2 req-29afc3fd-3a77-43ee-bf80-ef54527c1d56 service neutron] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:34.790054 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9b2044d8-e845-4df6-af19-5c05415543c2 req-29afc3fd-3a77-43ee-bf80-ef54527c1d56 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:34.799996 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9b2044d8-e845-4df6-af19-5c05415543c2 req-29afc3fd-3a77-43ee-bf80-ef54527c1d56 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:34.809967 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41342) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:34.851386 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41346) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:34.909912 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9b2044d8-e845-4df6-af19-5c05415543c2 req-29afc3fd-3a77-43ee-bf80-ef54527c1d56 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3127983 Nov 16 03:17:34.911092 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29afc3fd-3a77-43ee-bf80-ef54527c1d56 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=c583331c-7dfa-43ba-9ccf-f1ce9053f136,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:35.122648 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecd0b38-62e7-4e47-b190-e4297870e284 req-c779c7c0-b007-4d14-947d-f3d58c2a0aed tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:35.124645 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4ecd0b38-62e7-4e47-b190-e4297870e284 req-c779c7c0-b007-4d14-947d-f3d58c2a0aed tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.0731201 Nov 16 03:17:35.199812 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4ecd0b38-62e7-4e47-b190-e4297870e284 req-1903b1c4-d562-4756-82b8-be41180878b8 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666106 Nov 16 03:17:35.250685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3e84c3a8-1d5c-4a93-906f-b6a056cc231a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.302206 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f78fb4cd-2c7a-4751-ada0-722006b4f539 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.357405 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9fa26d-3e75-41e2-ac22-fc9a92275fc9 req-7cf7e2c1-a9f2-4e5e-b732-4510f8b919df tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:35.360444 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca9fa26d-3e75-41e2-ac22-fc9a92275fc9 req-7cf7e2c1-a9f2-4e5e-b732-4510f8b919df tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 945 time: 0.0898533 Nov 16 03:17:35.420548 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3e84c3a8-1d5c-4a93-906f-b6a056cc231a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.431201 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3e84c3a8-1d5c-4a93-906f-b6a056cc231a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.450397 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca9fa26d-3e75-41e2-ac22-fc9a92275fc9 req-43bf47dc-3044-481e-b5d8-14fa5d5b9b66 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763099 Nov 16 03:17:35.486525 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e84c3a8-1d5c-4a93-906f-b6a056cc231a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4dccc336-6481-472b-9f0b-79737509a845,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:35.502988 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f78fb4cd-2c7a-4751-ada0-722006b4f539 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.515107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41368) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:35.525461 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3e84c3a8-1d5c-4a93-906f-b6a056cc231a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=12f98077e5004f4e9b87c0c322eab5d9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7142344 Nov 16 03:17:35.531328 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f78fb4cd-2c7a-4751-ada0-722006b4f539 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.588699 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f78fb4cd-2c7a-4751-ada0-722006b4f539 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c7d9ccc5d4f7459baf9204fc94093f83&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7327442 Nov 16 03:17:35.589042 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78fb4cd-2c7a-4751-ada0-722006b4f539 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07a4f2a1-c940-4627-88a4-40681904da7a,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:35.591430 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41372) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:35.618981 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d7612b2-9aec-45fe-880a-5c8238779edb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.664346 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d7612b2-9aec-45fe-880a-5c8238779edb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.725631 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ea682-4e6f-4b0c-b138-cff43afea943 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.728422 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.773930 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ea682-4e6f-4b0c-b138-cff43afea943 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.813938 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d898df0-d3b7-414c-819c-aaf30f431391 req-dd28fc0c-c870-4212-84f7-bd39e07bdd28 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:35.815537 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d898df0-d3b7-414c-819c-aaf30f431391 req-dd28fc0c-c870-4212-84f7-bd39e07bdd28 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 944 time: 0.1238871 Nov 16 03:17:35.835743 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d7612b2-9aec-45fe-880a-5c8238779edb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.838835 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d7612b2-9aec-45fe-880a-5c8238779edb admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.840532 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8d7612b2-9aec-45fe-880a-5c8238779edb admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4dccc336-6481-472b-9f0b-79737509a845 HTTP/1.1" status: 204 len: 168 time: 0.3241491 Nov 16 03:17:35.851881 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d7612b2-9aec-45fe-880a-5c8238779edb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4dccc336-6481-472b-9f0b-79737509a845,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:35.907176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c7ca7b87-66b6-45ce-9656-e62a40792408 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:17:35.930479 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ea682-4e6f-4b0c-b138-cff43afea943 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.933621 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ea682-4e6f-4b0c-b138-cff43afea943 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:35.944424 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4f5ea682-4e6f-4b0c-b138-cff43afea943 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/07a4f2a1-c940-4627-88a4-40681904da7a HTTP/1.1" status: 204 len: 168 time: 0.3502007 Nov 16 03:17:35.946674 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41388) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:35.953832 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device f7e69534-b12b-41e4-b78d-014ae8dee4db up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:35.997760 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5ea682-4e6f-4b0c-b138-cff43afea943 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07a4f2a1-c940-4627-88a4-40681904da7a,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:36.012811 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d898df0-d3b7-414c-819c-aaf30f431391 req-4ce5fd55-8a87-444a-942a-56429998a78e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1570563 Nov 16 03:17:36.168169 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port f7e69534-b12b-41e4-b78d-014ae8dee4db completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:17:36.182424 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port f7e69534-b12b-41e4-b78d-014ae8dee4db triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:36.183436 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.305733 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c7ca7b87-66b6-45ce-9656-e62a40792408, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c7ca7b87-66b6-45ce-9656-e62a40792408,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:36.347983 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'c7ca7b87-66b6-45ce-9656-e62a40792408', 'network_id': 'b8800875-2e98-4cb6-a3a9-9d5ee637458a', 'port_id': 'c7ca7b87-66b6-45ce-9656-e62a40792408', 'mac_address': 'fa:16:3e:0b:83:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 331, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd29e78fd-50ef-4647-88a4-83b1f418a6b5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:17:36.468572 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de66d6ec-7064-4075-990b-101eb3eca759 req-80f01e2e-0935-467e-9f85-58ce0180bf81 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:36.471440 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de66d6ec-7064-4075-990b-101eb3eca759 req-80f01e2e-0935-467e-9f85-58ce0180bf81 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.1128218 Nov 16 03:17:36.473605 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.505020 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.530251 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-851e4625-36d2-4430-a38a-6a4cc6fa9561 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.549175 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b88a542c-0928-49cd-81c8-e95440adc731', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7e69534-b12b-41e4-b78d-014ae8dee4db'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:36.553312 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-452658d2-2182-4891-8aa9-6c1f623c6933" -d '{"events": [{"server_uuid": "b88a542c-0928-49cd-81c8-e95440adc731", "name": "network-vif-plugged", "status": "completed", "tag": "f7e69534-b12b-41e4-b78d-014ae8dee4db"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:36.575545 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c7ca7b87-66b6-45ce-9656-e62a40792408 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:17:36.666751 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de66d6ec-7064-4075-990b-101eb3eca759 req-a10e8771-60dd-4f8c-a813-1e121893a4ae tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1733024 Nov 16 03:17:36.707622 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port f7e69534-b12b-41e4-b78d-014ae8dee4db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:36.720616 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c7ca7b87-66b6-45ce-9656-e62a40792408, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c7ca7b87-66b6-45ce-9656-e62a40792408,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:36.724911 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.728151 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 437cd5b7-c458-4185-9487-1110be169765 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:36.737911 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41410) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:36.781074 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-851e4625-36d2-4430-a38a-6a4cc6fa9561 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.790754 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-851e4625-36d2-4430-a38a-6a4cc6fa9561 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.826408 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41414) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:36.864722 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e36a16e5-1b20-4bae-bca0-ea641d6093f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.865677 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc767f2b-92ff-4b90-9656-73f84dd4b589 x-openstack-request-id: req-cc767f2b-92ff-4b90-9656-73f84dd4b589 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:36.866474 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b88a542c-0928-49cd-81c8-e95440adc731", "name": "network-vif-plugged", "status": "completed", "tag": "f7e69534-b12b-41e4-b78d-014ae8dee4db", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:36.866629 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-cc767f2b-92ff-4b90-9656-73f84dd4b589 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:36.867089 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b88a542c-0928-49cd-81c8-e95440adc731', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7e69534-b12b-41e4-b78d-014ae8dee4db', 'code': 200} Nov 16 03:17:36.882896 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.901952 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4cfdf71e-1bc4-46c4-89cd-abf40b6cb556 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:36.935376 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f03ea8-dc88-4d0f-ba18-78e2765a5862 req-e9505be6-6162-43ab-8fcd-bb2fc2e02e76 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:36.937006 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e6f03ea8-dc88-4d0f-ba18-78e2765a5862 req-e9505be6-6162-43ab-8fcd-bb2fc2e02e76 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 946 time: 0.2210782 Nov 16 03:17:36.953497 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851e4625-36d2-4430-a38a-6a4cc6fa9561 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c4f00a7-5944-4398-8d5b-813bc94a6793,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:36.991766 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 437cd5b7-c458-4185-9487-1110be169765 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:17:37.013530 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 437cd5b7-c458-4185-9487-1110be169765 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:37.014015 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.088129 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e6f03ea8-dc88-4d0f-ba18-78e2765a5862 req-5d1f8760-52d3-4df1-8d90-3a180a70630a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1275883 Nov 16 03:17:37.098852 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=f7e69534-b12b-41e4-b78d-014ae8dee4db,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:37.139606 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e36a16e5-1b20-4bae-bca0-ea641d6093f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.143570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4cfdf71e-1bc4-46c4-89cd-abf40b6cb556 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.151330 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-851e4625-36d2-4430-a38a-6a4cc6fa9561 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=698675e30b59432a9b29a96945a9dc53&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2019091 Nov 16 03:17:37.151625 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e36a16e5-1b20-4bae-bca0-ea641d6093f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.154819 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41426) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:37.157629 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4cfdf71e-1bc4-46c4-89cd-abf40b6cb556 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.229901 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['c7ca7b87-66b6-45ce-9656-e62a40792408'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:17:37.277494 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cfdf71e-1bc4-46c4-89cd-abf40b6cb556 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b4ea28d-e0f1-4643-a7fc-6ae413defd6b,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:37.290994 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-4cfdf71e-1bc4-46c4-89cd-abf40b6cb556 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=abbe6b6a9e2f4939a853d1cc6a5827d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4573760 Nov 16 03:17:37.292757 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36a16e5-1b20-4bae-bca0-ea641d6093f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cea359ea-ed6d-437b-959c-c1ab3a21a212,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:37.296966 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41432) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:37.308673 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-e36a16e5-1b20-4bae-bca0-ea641d6093f1 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d256e96af89b4f9e922f30fc97183669&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5592861 Nov 16 03:17:37.309387 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c7ca7b87-66b6-45ce-9656-e62a40792408,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:37.309731 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41434) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:37.408816 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b560bd67-5902-4b54-969d-be6970cafe58 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.458335 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b560bd67-5902-4b54-969d-be6970cafe58 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.517848 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.519027 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9deaa33-69ca-43e3-ac7a-5f1f68bcb376 req-aaaa993e-af5c-4f5d-84a8-9f4d00417b1b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:37.521620 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c9deaa33-69ca-43e3-ac7a-5f1f68bcb376 req-aaaa993e-af5c-4f5d-84a8-9f4d00417b1b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 944 time: 0.3298132 Nov 16 03:17:37.543841 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7b826a48-ac0f-4a97-8f21-f41d5199f6c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.633477 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb7cc61e-b622-44a0-be1b-59f3a2f8c60a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.635923 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b560bd67-5902-4b54-969d-be6970cafe58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.642267 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b560bd67-5902-4b54-969d-be6970cafe58 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.645199 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b560bd67-5902-4b54-969d-be6970cafe58 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4b4ea28d-e0f1-4643-a7fc-6ae413defd6b HTTP/1.1" status: 204 len: 168 time: 0.3423650 Nov 16 03:17:37.663658 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b560bd67-5902-4b54-969d-be6970cafe58 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b4ea28d-e0f1-4643-a7fc-6ae413defd6b,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:37.725290 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7b826a48-ac0f-4a97-8f21-f41d5199f6c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.731107 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 437cd5b7-c458-4185-9487-1110be169765, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=437cd5b7-c458-4185-9487-1110be169765,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:37.747714 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:37.778356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5508b042-76ae-4501-b520-b9740071f31f req-0169732f-f04c-4a11-ba5f-7c6f904af86d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:37.786980 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5508b042-76ae-4501-b520-b9740071f31f req-0169732f-f04c-4a11-ba5f-7c6f904af86d service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 1099 time: 0.4515069 Nov 16 03:17:38.008090 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=437cd5b7-c458-4185-9487-1110be169765,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:38.039876 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c9deaa33-69ca-43e3-ac7a-5f1f68bcb376 req-09fc4ab3-630e-4a3b-938b-df66aa00d6e9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5002341 Nov 16 03:17:38.046463 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb7cc61e-b622-44a0-be1b-59f3a2f8c60a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:38.240580 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5508b042-76ae-4501-b520-b9740071f31f req-1e8e7149-5d6d-4ecd-a695-fc5fa5544ca2 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3913784 Nov 16 03:17:38.305096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116d529c-0cf0-4241-8314-c63a63fdf0c6 req-4572f6f1-dc89-47bc-b2e6-fa52911694ad tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:38.307797 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-116d529c-0cf0-4241-8314-c63a63fdf0c6 req-4572f6f1-dc89-47bc-b2e6-fa52911694ad tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.3198042 Nov 16 03:17:38.313719 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7b826a48-ac0f-4a97-8f21-f41d5199f6c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:38.318409 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7b826a48-ac0f-4a97-8f21-f41d5199f6c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:38.320634 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7b826a48-ac0f-4a97-8f21-f41d5199f6c4 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7c4f00a7-5944-4398-8d5b-813bc94a6793 HTTP/1.1" status: 204 len: 168 time: 1.1628573 Nov 16 03:17:38.353464 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b826a48-ac0f-4a97-8f21-f41d5199f6c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c4f00a7-5944-4398-8d5b-813bc94a6793,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:38.392781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb7cc61e-b622-44a0-be1b-59f3a2f8c60a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:38.397655 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb7cc61e-b622-44a0-be1b-59f3a2f8c60a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:38.399522 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-eb7cc61e-b622-44a0-be1b-59f3a2f8c60a admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/cea359ea-ed6d-437b-959c-c1ab3a21a212 HTTP/1.1" status: 204 len: 168 time: 1.0830162 Nov 16 03:17:38.413683 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0c199e-9926-461f-b044-f1807042ffd6 req-3f553351-1284-4842-8de2-77736f2ac10c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:38.416060 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cb0c199e-9926-461f-b044-f1807042ffd6 req-3f553351-1284-4842-8de2-77736f2ac10c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 946 time: 0.1850469 Nov 16 03:17:38.471651 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb7cc61e-b622-44a0-be1b-59f3a2f8c60a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cea359ea-ed6d-437b-959c-c1ab3a21a212,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:38.517106 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-116d529c-0cf0-4241-8314-c63a63fdf0c6 req-5ac28eb1-dfd5-4020-90be-be752f4f9acd tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1945086 Nov 16 03:17:38.605152 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cb0c199e-9926-461f-b044-f1807042ffd6 req-35a9c02a-1c7d-4876-9755-af3d42985bc6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1660819 Nov 16 03:17:38.870222 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12b32c77-f241-4147-abf7-2b54d564588a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '437cd5b7-c458-4185-9487-1110be169765'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:38.880373 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b375299-e9f1-4ec1-8572-0afb3a29f4c2" -d '{"events": [{"server_uuid": "12b32c77-f241-4147-abf7-2b54d564588a", "name": "network-vif-plugged", "status": "completed", "tag": "437cd5b7-c458-4185-9487-1110be169765"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:38.991812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c97b7501-fa6c-47bf-9602-d459b6cd1fe9 x-openstack-request-id: req-c97b7501-fa6c-47bf-9602-d459b6cd1fe9 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:38.992830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "12b32c77-f241-4147-abf7-2b54d564588a", "name": "network-vif-plugged", "status": "completed", "tag": "437cd5b7-c458-4185-9487-1110be169765", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:38.993409 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c97b7501-fa6c-47bf-9602-d459b6cd1fe9 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:38.994511 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '12b32c77-f241-4147-abf7-2b54d564588a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '437cd5b7-c458-4185-9487-1110be169765', 'code': 200} Nov 16 03:17:39.210132 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41510) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:39.256999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e84fa60-475c-4be3-9d85-fccdf9e964fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.369996 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d4644c-c59e-4786-85c2-3cf4e10fe78c req-2a6e64f8-ec10-4c92-b483-db5596e0b538 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:39.371827 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8d4644c-c59e-4786-85c2-3cf4e10fe78c req-2a6e64f8-ec10-4c92-b483-db5596e0b538 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1007531 Nov 16 03:17:39.593005 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e84fa60-475c-4be3-9d85-fccdf9e964fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.614455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e84fa60-475c-4be3-9d85-fccdf9e964fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.651677 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8d4644c-c59e-4786-85c2-3cf4e10fe78c req-0859b561-bd41-4dae-bf4c-71becd668bdc tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2546299 Nov 16 03:17:39.703616 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9750b6c0-f295-4ea5-a2f3-bd2edfb9558c req-48d8dc25-a156-4d34-b898-6fa82c37f7c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:39.706880 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9750b6c0-f295-4ea5-a2f3-bd2edfb9558c req-48d8dc25-a156-4d34-b898-6fa82c37f7c4 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 1098 time: 0.2661448 Nov 16 03:17:39.712606 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-1e84fa60-475c-4be3-9d85-fccdf9e964fa admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=bd6b65856d69424a8a6a20977f961902&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4996822 Nov 16 03:17:39.714112 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e84fa60-475c-4be3-9d85-fccdf9e964fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30c40c5f-d121-4fc7-b1b9-e71492740869,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:39.717156 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41526) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:39.820100 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f3dac368-5d76-4a91-bfe1-e0db73d467f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.873099 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f3dac368-5d76-4a91-bfe1-e0db73d467f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.935418 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c7ca7b87-66b6-45ce-9656-e62a40792408 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:17:39.950074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81833cf3-6e6f-4db8-ba94-37f05185a696 req-828ce7d2-295c-4a4f-bf57-72422be41a06 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:39.953590 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-81833cf3-6e6f-4db8-ba94-37f05185a696 req-828ce7d2-295c-4a4f-bf57-72422be41a06 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 946 time: 0.2056136 Nov 16 03:17:39.959074 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9750b6c0-f295-4ea5-a2f3-bd2edfb9558c req-6738a2c6-d670-467e-bb69-a98e94ee8a98 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2365937 Nov 16 03:17:39.968170 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f3dac368-5d76-4a91-bfe1-e0db73d467f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.970393 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:17:39.973989 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f3dac368-5d76-4a91-bfe1-e0db73d467f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:39.976858 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f3dac368-5d76-4a91-bfe1-e0db73d467f6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/30c40c5f-d121-4fc7-b1b9-e71492740869 HTTP/1.1" status: 204 len: 168 time: 0.2565472 Nov 16 03:17:39.996288 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3dac368-5d76-4a91-bfe1-e0db73d467f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30c40c5f-d121-4fc7-b1b9-e71492740869,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:40.065622 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41548) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:40.118248 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-81833cf3-6e6f-4db8-ba94-37f05185a696 req-e934f0e0-062a-4f76-8cb6-a3e12a1ed43f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1515236 Nov 16 03:17:40.139404 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port c7ca7b87-66b6-45ce-9656-e62a40792408 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:17:40.157298 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port c7ca7b87-66b6-45ce-9656-e62a40792408 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:17:40.158381 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:40.435940 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:40.513650 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c7ca7b87-66b6-45ce-9656-e62a40792408, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c7ca7b87-66b6-45ce-9656-e62a40792408,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:40.529176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:40.635457 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c7ca7b87-66b6-45ce-9656-e62a40792408,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:40.728916 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bb62556c-05c3-4878-a211-0562d8a86730 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:40.986004 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b6aca7c-b1ba-4a77-8381-558dcaad9f2f req-c72b79c5-a9c3-4d7f-a175-2ad295aeb002 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:41.000748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41418e21-082d-437e-acdd-7219a2790fcc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7ca7b87-66b6-45ce-9656-e62a40792408'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:41.002541 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b6aca7c-b1ba-4a77-8381-558dcaad9f2f req-c72b79c5-a9c3-4d7f-a175-2ad295aeb002 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1512568 Nov 16 03:17:41.005088 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e381ad2-fe6b-4829-a9b2-3a0f6e621b34" -d '{"events": [{"server_uuid": "41418e21-082d-437e-acdd-7219a2790fcc", "name": "network-vif-plugged", "status": "completed", "tag": "c7ca7b87-66b6-45ce-9656-e62a40792408"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:41.018527 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bb62556c-05c3-4878-a211-0562d8a86730 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:41.027068 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bb62556c-05c3-4878-a211-0562d8a86730 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:41.135485 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-bb62556c-05c3-4878-a211-0562d8a86730 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=0d5c2939904e4024925b89000a37b91b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0686953 Nov 16 03:17:41.138002 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb62556c-05c3-4878-a211-0562d8a86730 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0aff70b4-24e3-4ae8-a419-1063e3d826cd,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:41.154792 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41596) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:41.224196 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b6aca7c-b1ba-4a77-8381-558dcaad9f2f req-89fd4693-a331-48da-a083-b1f5849eedb8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2178156 Nov 16 03:17:41.323038 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43ae5a57-06ac-41e7-ab98-1082cdf772a4 x-openstack-request-id: req-43ae5a57-06ac-41e7-ab98-1082cdf772a4 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:41.326044 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41418e21-082d-437e-acdd-7219a2790fcc", "name": "network-vif-plugged", "status": "completed", "tag": "c7ca7b87-66b6-45ce-9656-e62a40792408", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:41.326044 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-43ae5a57-06ac-41e7-ab98-1082cdf772a4 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:41.326044 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41418e21-082d-437e-acdd-7219a2790fcc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7ca7b87-66b6-45ce-9656-e62a40792408', 'code': 200} Nov 16 03:17:41.389128 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a7facd75-51a3-42df-84b1-78e800aade30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:41.445222 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a7facd75-51a3-42df-84b1-78e800aade30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:41.549055 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a7facd75-51a3-42df-84b1-78e800aade30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:41.554375 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a7facd75-51a3-42df-84b1-78e800aade30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:41.568945 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-a7facd75-51a3-42df-84b1-78e800aade30 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/0aff70b4-24e3-4ae8-a419-1063e3d826cd HTTP/1.1" status: 204 len: 168 time: 0.4063866 Nov 16 03:17:41.592383 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7facd75-51a3-42df-84b1-78e800aade30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0aff70b4-24e3-4ae8-a419-1063e3d826cd,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:41.624906 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41608) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:41.698009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695ab19b-a537-4c29-b584-e655f99fd081 req-1f45c31c-7c56-4c9f-931f-9c158f2415fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:41.699890 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-695ab19b-a537-4c29-b584-e655f99fd081 req-1f45c31c-7c56-4c9f-931f-9c158f2415fc service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.0694170 Nov 16 03:17:41.815009 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-695ab19b-a537-4c29-b584-e655f99fd081 req-be5422e4-31c9-4aac-9efe-caecefaaae7e service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534732 Nov 16 03:17:42.166482 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-34c95d58-5244-4ddc-b305-030dc3d6719e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.368079 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-34c95d58-5244-4ddc-b305-030dc3d6719e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.381285 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-34c95d58-5244-4ddc-b305-030dc3d6719e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.424895 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95cee4d2-4f1b-4773-8ceb-4415ad04c4fa req-cb21473d-2e85-4529-bd77-e4d92e7e9568 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:42.426531 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-95cee4d2-4f1b-4773-8ceb-4415ad04c4fa req-cb21473d-2e85-4529-bd77-e4d92e7e9568 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.0828030 Nov 16 03:17:42.464174 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-34c95d58-5244-4ddc-b305-030dc3d6719e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=24d7bf61135a459f987182c30fb995ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8356335 Nov 16 03:17:42.470447 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41634) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:42.479545 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34c95d58-5244-4ddc-b305-030dc3d6719e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60840b92-efd1-4b4f-bc1e-935474789090,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:42.533709 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-95cee4d2-4f1b-4773-8ceb-4415ad04c4fa req-30e7c6b6-4b3a-4031-87ed-4fe9cbea9182 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1003339 Nov 16 03:17:42.575500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4529d9e7-1547-4927-8695-3570b7046d45 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.600191 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41640) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:42.647314 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-de0a5e7d-b375-427c-957f-94a4e077c385 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.659667 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4529d9e7-1547-4927-8695-3570b7046d45 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.774536 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4529d9e7-1547-4927-8695-3570b7046d45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.780779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4529d9e7-1547-4927-8695-3570b7046d45 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.789566 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-4529d9e7-1547-4927-8695-3570b7046d45 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/60840b92-efd1-4b4f-bc1e-935474789090 HTTP/1.1" status: 204 len: 168 time: 0.3170729 Nov 16 03:17:42.841881 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4529d9e7-1547-4927-8695-3570b7046d45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60840b92-efd1-4b4f-bc1e-935474789090,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:42.971615 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-de0a5e7d-b375-427c-957f-94a4e077c385 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:42.983811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-de0a5e7d-b375-427c-957f-94a4e077c385 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:43.138683 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de0a5e7d-b375-427c-957f-94a4e077c385 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83dedd96-fe93-4bc9-acbb-77d57f89ce06,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:43.179129 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-de0a5e7d-b375-427c-957f-94a4e077c385 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=554f82a3aab34d698a5b9005dc9512ec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5771160 Nov 16 03:17:43.181850 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41660) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:43.335116 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7634dd97-c01d-4408-9240-720a64bca90a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:43.421946 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7634dd97-c01d-4408-9240-720a64bca90a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:43.618241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dab229-e341-48c9-9e44-83ec8ccf7ad1 req-b081f57d-bbcb-484a-9069-3baed53a7169 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:43.619874 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b7dab229-e341-48c9-9e44-83ec8ccf7ad1 req-b081f57d-bbcb-484a-9069-3baed53a7169 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1769266 Nov 16 03:17:43.622502 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd494237-c684-4638-a125-6a13b088e544 req-ee2d8fb0-f74c-4d34-87b8-e8089a67e137 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:43.624155 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-ee2d8fb0-f74c-4d34-87b8-e8089a67e137 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 1098 time: 0.1790748 Nov 16 03:17:43.643673 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7634dd97-c01d-4408-9240-720a64bca90a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:43.650354 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7634dd97-c01d-4408-9240-720a64bca90a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:43.650354 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7634dd97-c01d-4408-9240-720a64bca90a admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/83dedd96-fe93-4bc9-acbb-77d57f89ce06 HTTP/1.1" status: 204 len: 168 time: 0.4626074 Nov 16 03:17:43.713147 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7634dd97-c01d-4408-9240-720a64bca90a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83dedd96-fe93-4bc9-acbb-77d57f89ce06,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:43.758059 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b7dab229-e341-48c9-9e44-83ec8ccf7ad1 req-3530c28c-9f42-4964-92a2-eb278f0c0324 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1238763 Nov 16 03:17:43.786255 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd494237-c684-4638-a125-6a13b088e544 req-54cf7467-8611-4cb2-9693-221077851750 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:43.787787 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-54cf7467-8611-4cb2-9693-221077851750 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.1295884 Nov 16 03:17:43.851337 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-dd09a4c1-0846-4137-a899-ff5816d32c67 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=437cd5b7-c458-4185-9487-1110be169765 HTTP/1.1" status: 200 len: 217 time: 0.0553198 Nov 16 03:17:43.914890 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd494237-c684-4638-a125-6a13b088e544 req-c3506290-d0ba-4107-99e4-c74335ad6907 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:43.916335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-c3506290-d0ba-4107-99e4-c74335ad6907 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.0574777 Nov 16 03:17:43.954075 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-f24925f9-8a7b-4475-a197-9a2899bc3841 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294490 Nov 16 03:17:43.988374 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41682) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:44.010693 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2a81d8ed-e791-4610-87b6-5cd9596013b5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.102357 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-806b42cb-aa2f-4012-a2a8-f3b4708a67d1 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405504 Nov 16 03:17:44.145033 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2a81d8ed-e791-4610-87b6-5cd9596013b5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.150532 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2a81d8ed-e791-4610-87b6-5cd9596013b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.231134 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2a81d8ed-e791-4610-87b6-5cd9596013b5 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=684212b60e684e0d948ccfeef69495be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2408690 Nov 16 03:17:44.236307 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41690) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:44.241698 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a81d8ed-e791-4610-87b6-5cd9596013b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f24eaf4-bacf-460d-8a10-4d8a26cd16f1,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:44.345612 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd494237-c684-4638-a125-6a13b088e544 req-f1204247-f318-4f99-89bb-5e6b45034798 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2229066 Nov 16 03:17:44.377703 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ebc65c31-1347-42cc-b65d-7960ca281431 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.400724 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0ba60c70-8e30-493e-b1fa-07a0e595f6ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.444701 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0ba60c70-8e30-493e-b1fa-07a0e595f6ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.822154 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0ba60c70-8e30-493e-b1fa-07a0e595f6ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.828528 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0ba60c70-8e30-493e-b1fa-07a0e595f6ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:44.834650 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-0ba60c70-8e30-493e-b1fa-07a0e595f6ea admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/2f24eaf4-bacf-460d-8a10-4d8a26cd16f1 HTTP/1.1" status: 204 len: 168 time: 0.5949862 Nov 16 03:17:44.849857 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba60c70-8e30-493e-b1fa-07a0e595f6ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f24eaf4-bacf-460d-8a10-4d8a26cd16f1,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:44.881908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41712) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:44.947214 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-01af7622-3d3d-461a-b990-0e74ac4bbadc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.047802 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e76eb52-f084-4a92-978d-df4d159266e6 req-f54cc725-dd10-4b16-8e41-a482b615f39d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:45.049848 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2e76eb52-f084-4a92-978d-df4d159266e6 req-f54cc725-dd10-4b16-8e41-a482b615f39d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1262937 Nov 16 03:17:45.126187 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-01af7622-3d3d-461a-b990-0e74ac4bbadc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.132104 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-01af7622-3d3d-461a-b990-0e74ac4bbadc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.151684 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2e76eb52-f084-4a92-978d-df4d159266e6 req-18c6aec5-42f2-48b9-9786-dfb43f10c39d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898087 Nov 16 03:17:45.162424 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41720) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:45.189620 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01af7622-3d3d-461a-b990-0e74ac4bbadc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=865b402d-707b-4dd7-8630-b3d7ad5afd4e,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:45.196246 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-01af7622-3d3d-461a-b990-0e74ac4bbadc admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a20ed30400014cb39e92848809d65a2e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3127472 Nov 16 03:17:45.200481 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41724) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:45.279970 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fa7943b2-8965-45e1-8799-7244773003e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.313527 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fa7943b2-8965-45e1-8799-7244773003e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.390407 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fa7943b2-8965-45e1-8799-7244773003e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.393338 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fa7943b2-8965-45e1-8799-7244773003e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.397091 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-fa7943b2-8965-45e1-8799-7244773003e5 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/865b402d-707b-4dd7-8630-b3d7ad5afd4e HTTP/1.1" status: 204 len: 168 time: 0.1932211 Nov 16 03:17:45.404960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7943b2-8965-45e1-8799-7244773003e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=865b402d-707b-4dd7-8630-b3d7ad5afd4e,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:45.490425 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f94c9b25-7371-4323-9b17-451b8078210e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.606203 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f94c9b25-7371-4323-9b17-451b8078210e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.612240 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f94c9b25-7371-4323-9b17-451b8078210e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.663554 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f94c9b25-7371-4323-9b17-451b8078210e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=7b7bfc4c34264b47b1c35c8c44eba0f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4996867 Nov 16 03:17:45.664629 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94c9b25-7371-4323-9b17-451b8078210e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74a89ae6-17e8-441a-8071-b64f32b9fd78,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:45.667785 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41748) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:45.732346 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb26a97b-6e52-494f-bbd3-5061989cbb91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.767820 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb26a97b-6e52-494f-bbd3-5061989cbb91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.858572 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb26a97b-6e52-494f-bbd3-5061989cbb91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.862031 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eb26a97b-6e52-494f-bbd3-5061989cbb91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:45.863304 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-eb26a97b-6e52-494f-bbd3-5061989cbb91 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/74a89ae6-17e8-441a-8071-b64f32b9fd78 HTTP/1.1" status: 204 len: 168 time: 0.1943924 Nov 16 03:17:45.872310 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb26a97b-6e52-494f-bbd3-5061989cbb91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74a89ae6-17e8-441a-8071-b64f32b9fd78,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:46.337388 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c92828c-b244-4a66-8e44-443f1095f950 req-910506d8-ff81-4c7b-a375-1dbcf736cf6c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:46.339636 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5c92828c-b244-4a66-8e44-443f1095f950 req-910506d8-ff81-4c7b-a375-1dbcf736cf6c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.0805666 Nov 16 03:17:46.433656 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5c92828c-b244-4a66-8e44-443f1095f950 req-cb6ff534-0a6e-46e2-9444-f969ca79ee38 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867684 Nov 16 03:17:46.450420 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41798) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:46.464822 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-230816de-406a-426b-a78e-3fc0468ec3b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.572253 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-230816de-406a-426b-a78e-3fc0468ec3b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.581987 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-230816de-406a-426b-a78e-3fc0468ec3b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.653974 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-230816de-406a-426b-a78e-3fc0468ec3b7 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e6fd61ec357749f49a60c76b44599da0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2020388 Nov 16 03:17:46.655363 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-230816de-406a-426b-a78e-3fc0468ec3b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49381fc3-75fd-4e52-b5df-804b497ba95d,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:46.658356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41800) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:46.754847 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6119eab-bb4d-4fa9-8711-bd944af3d7b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.786923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6119eab-bb4d-4fa9-8711-bd944af3d7b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.872202 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6119eab-bb4d-4fa9-8711-bd944af3d7b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.875963 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6119eab-bb4d-4fa9-8711-bd944af3d7b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:46.877345 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a6119eab-bb4d-4fa9-8711-bd944af3d7b3 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/49381fc3-75fd-4e52-b5df-804b497ba95d HTTP/1.1" status: 204 len: 168 time: 0.2165620 Nov 16 03:17:46.890150 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6119eab-bb4d-4fa9-8711-bd944af3d7b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49381fc3-75fd-4e52-b5df-804b497ba95d,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:47.011947 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41816) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:47.308911 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f416e48c-b6df-41f7-8968-012cc3b78892 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.402064 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f416e48c-b6df-41f7-8968-012cc3b78892 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.408832 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f416e48c-b6df-41f7-8968-012cc3b78892 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.464430 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f416e48c-b6df-41f7-8968-012cc3b78892 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b51de50158d04995a54933e00dd3cb41&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4512033 Nov 16 03:17:47.464659 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41834) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:47.466691 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f416e48c-b6df-41f7-8968-012cc3b78892 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fa23216-0d75-44b8-9bbb-3c03e9119a31,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:47.597129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2014f9b3-f736-49bd-9159-f89bcc4215b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.622844 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2014f9b3-f736-49bd-9159-f89bcc4215b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.714419 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2014f9b3-f736-49bd-9159-f89bcc4215b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.721091 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2014f9b3-f736-49bd-9159-f89bcc4215b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:47.723866 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2014f9b3-f736-49bd-9159-f89bcc4215b2 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7fa23216-0d75-44b8-9bbb-3c03e9119a31 HTTP/1.1" status: 204 len: 168 time: 0.2576814 Nov 16 03:17:47.741783 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2014f9b3-f736-49bd-9159-f89bcc4215b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fa23216-0d75-44b8-9bbb-3c03e9119a31,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:47.754677 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf4fa04-ee36-4e6c-92a5-9550026b6460 req-82ec76ee-aee5-4806-90b9-144f3d1977b3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:47.757765 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-baf4fa04-ee36-4e6c-92a5-9550026b6460 req-82ec76ee-aee5-4806-90b9-144f3d1977b3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1056468 Nov 16 03:17:47.841495 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-baf4fa04-ee36-4e6c-92a5-9550026b6460 req-0053395a-cbb2-4be5-aaee-aef7f0bbacfb tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744977 Nov 16 03:17:48.436383 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2ad3bdda-1c56-477b-b623-c332d86bfc4c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.463761 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 41872) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:48.477481 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8aa0b400-b726-491c-8330-825826eba2d6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.569798 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8aa0b400-b726-491c-8330-825826eba2d6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.577191 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8aa0b400-b726-491c-8330-825826eba2d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.624504 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8aa0b400-b726-491c-8330-825826eba2d6 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=9f088cb30d5c4cbb91754754ff2caae8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1562867 Nov 16 03:17:48.624504 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa0b400-b726-491c-8330-825826eba2d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce871095-c3be-4815-8e7b-b3946689a4f3,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:48.625073 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 41876) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:48.739016 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-772d48c8-6abe-4267-a786-7e5dd8c1de8c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.778760 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-772d48c8-6abe-4267-a786-7e5dd8c1de8c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.864852 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-772d48c8-6abe-4267-a786-7e5dd8c1de8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.869675 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-772d48c8-6abe-4267-a786-7e5dd8c1de8c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:48.875789 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-772d48c8-6abe-4267-a786-7e5dd8c1de8c admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ce871095-c3be-4815-8e7b-b3946689a4f3 HTTP/1.1" status: 204 len: 168 time: 0.2483604 Nov 16 03:17:48.896245 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772d48c8-6abe-4267-a786-7e5dd8c1de8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce871095-c3be-4815-8e7b-b3946689a4f3,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:49.021062 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3612005f-5091-4bc6-af35-7639738e83ad req-b40a4e5a-e4f0-492a-b328-e53688a0b108 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:49.022963 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3612005f-5091-4bc6-af35-7639738e83ad req-b40a4e5a-e4f0-492a-b328-e53688a0b108 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.0957980 Nov 16 03:17:49.092005 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3612005f-5091-4bc6-af35-7639738e83ad req-8ad58826-8a0a-4128-84e9-d590d071e7fe tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608706 Nov 16 03:17:49.746690 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:50.338581 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cb072d-a279-4365-ab93-8d3de002ae2e req-39ceab92-d400-415f-a916-17bfe76e16d6 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:50.351754 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e8cb072d-a279-4365-ab93-8d3de002ae2e req-39ceab92-d400-415f-a916-17bfe76e16d6 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1455839 Nov 16 03:17:50.483115 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e8cb072d-a279-4365-ab93-8d3de002ae2e req-90ccb366-90c1-40a3-b549-ca2a180851e8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283326 Nov 16 03:17:51.486677 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:51.593509 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:51.706319 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370eadb9-0dcf-48c5-b051-2d2f8ff95375 req-3d76d6c8-87f9-473f-b44e-e62e24343d40 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:51.707948 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-370eadb9-0dcf-48c5-b051-2d2f8ff95375 req-3d76d6c8-87f9-473f-b44e-e62e24343d40 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.1496253 Nov 16 03:17:51.721602 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a850ee-8198-4c9d-a357-523ee015da7f req-f0b5769e-0af2-4b73-b903-fdfa78bd3c21 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:51.729093 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b1a850ee-8198-4c9d-a357-523ee015da7f req-f0b5769e-0af2-4b73-b903-fdfa78bd3c21 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1098936 Nov 16 03:17:51.823232 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b1a850ee-8198-4c9d-a357-523ee015da7f req-de711833-aaa8-4570-a506-77eddf44ec4e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921371 Nov 16 03:17:51.853737 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-370eadb9-0dcf-48c5-b051-2d2f8ff95375 req-23acd2ea-a7ce-4f90-8b20-d0b452dfbea4 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1175325 Nov 16 03:17:52.834788 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42120) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:53.028281 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb979642-0d85-408e-ab54-66768c8e8bba req-d28716ef-309c-4644-8f0f-b9f0d1d368e0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:53.031842 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb979642-0d85-408e-ab54-66768c8e8bba req-d28716ef-309c-4644-8f0f-b9f0d1d368e0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1148074 Nov 16 03:17:53.206636 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.235833 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f8e9d6c-a82d-481a-82d0-02474fca27f4 req-1c3cdfaf-bd9e-4617-a2fb-1c99725b1454 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:53.239958 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2f8e9d6c-a82d-481a-82d0-02474fca27f4 req-1c3cdfaf-bd9e-4617-a2fb-1c99725b1454 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.2057831 Nov 16 03:17:53.277860 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb979642-0d85-408e-ab54-66768c8e8bba req-531921b5-86de-4deb-ba20-dd08b4677866 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1803589 Nov 16 03:17:53.409193 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2f8e9d6c-a82d-481a-82d0-02474fca27f4 req-23f2498f-e6aa-456b-b554-6ff5aabde69b tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246047 Nov 16 03:17:53.514127 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.523052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.583824 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=0a33eb03acc74574be12592a7e460f8d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7469928 Nov 16 03:17:53.587971 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42188) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:53.600499 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e61f4f8c-dc24-4d3d-817d-09c7f4da441a,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:53.654686 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.655040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.655372 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.655705 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.656055 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.656435 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.656974 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.657292 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.657644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.657968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.658283 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.658601 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d286346-69a4-46a2-94e2-0d1e7b27e5b1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:53.699074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-842c701d-f9cd-41f0-ba6b-c907d4030e27 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.728063 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-842c701d-f9cd-41f0-ba6b-c907d4030e27 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.806544 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-842c701d-f9cd-41f0-ba6b-c907d4030e27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.806544 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-842c701d-f9cd-41f0-ba6b-c907d4030e27 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:53.806544 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-842c701d-f9cd-41f0-ba6b-c907d4030e27 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/e61f4f8c-dc24-4d3d-817d-09c7f4da441a HTTP/1.1" status: 204 len: 168 time: 0.2085228 Nov 16 03:17:53.830009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-842c701d-f9cd-41f0-ba6b-c907d4030e27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e61f4f8c-dc24-4d3d-817d-09c7f4da441a,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:54.160350 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-75ec95eb-1ff4-4fb4-a539-ab921b104cec tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:54.164338 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-75ec95eb-1ff4-4fb4-a539-ab921b104cec tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.1391890 Nov 16 03:17:54.280184 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42218) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:54.301622 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:54.398826 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Deleting port d7068ec0-21b9-465d-9309-774abd9482b7 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:17:54.399417 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:54.462129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:54.467802 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:54.567300 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=f2f8b5426e194502a0f68fb790778ed6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2857988 Nov 16 03:17:54.568311 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42228) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:54.607420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a23beb-b239-4c70-b795-a7ae5496e2e4 req-dcc65e2e-4277-489f-8817-c8d42221bd10 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:54.614778 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-36a23beb-b239-4c70-b795-a7ae5496e2e4 req-dcc65e2e-4277-489f-8817-c8d42221bd10 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1506484 Nov 16 03:17:54.638381 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] For port d7068ec0-21b9-465d-9309-774abd9482b7, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d7068ec0-21b9-465d-9309-774abd9482b7,segment=NetworkSegment(c87f961f-876c-4440-87a5-a87de8e1b0b6),segment_id=c87f961f-876c-4440-87a5-a87de8e1b0b6)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:17:54.639048 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:54.721967 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Calling delete_port for d7068ec0-21b9-465d-9309-774abd9482b7 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:17:54.823368 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1ec4bf9-d06a-4573-a6ab-da24fa1e81ce,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:54.849654 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.850612 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.851255 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.851596 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.852028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.852513 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.852886 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.853199 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.853720 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.854181 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.855156 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.855820 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c926bc9-8a01-4955-bf9f-b2e59909afb1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:17:54.858575 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42234) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:54.875440 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a319f96-fff5-42ee-932a-95d376f10f64 req-22471e54-0ab3-4eaf-842f-f38a1828fa0a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:54.877106 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8a319f96-fff5-42ee-932a-95d376f10f64 req-22471e54-0ab3-4eaf-842f-f38a1828fa0a tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 946 time: 0.2548347 Nov 16 03:17:54.885924 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-36a23beb-b239-4c70-b795-a7ae5496e2e4 req-4a0260e9-d7a0-4cde-b6be-27a77bbb2819 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2514203 Nov 16 03:17:54.919942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-312dae08-9a30-4535-82c0-c422bd15d8ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:54.958845 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-312dae08-9a30-4535-82c0-c422bd15d8ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.019666 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8a319f96-fff5-42ee-932a-95d376f10f64 req-9a2c4705-d907-41cc-8ce6-4d0a8e22cd53 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/security-groups?id=cc2b27c1-d719-401a-85be-f411edde75d4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1258564 Nov 16 03:17:55.046068 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-312dae08-9a30-4535-82c0-c422bd15d8ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.051443 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-312dae08-9a30-4535-82c0-c422bd15d8ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.071046 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-312dae08-9a30-4535-82c0-c422bd15d8ff admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/d1ec4bf9-d06a-4573-a6ab-da24fa1e81ce HTTP/1.1" status: 204 len: 168 time: 0.4998817 Nov 16 03:17:55.093010 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-312dae08-9a30-4535-82c0-c422bd15d8ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1ec4bf9-d06a-4573-a6ab-da24fa1e81ce,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:55.098137 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.156698 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Pushing event deleted for resources: {'Port': ['ID=d7068ec0-21b9-465d-9309-774abd9482b7,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:55.166224 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['d7068ec0-21b9-465d-9309-774abd9482b7'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:17:55.285366 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-497b1a50-5450-42bf-9955-9b72ba2a8364 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.295523 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] No DVR routers for this DVR port d7068ec0-21b9-465d-9309-774abd9482b7 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:17:55.374915 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.380397 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-28ff8e6b-611d-492a-9324-565f2b611bb0 req-98ebfd1a-0013-411b-95f7-098875d57185 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.11 "DELETE /v2.0/ports/d7068ec0-21b9-465d-9309-774abd9482b7 HTTP/1.1" status: 204 len: 173 time: 1.2084835 Nov 16 03:17:55.380986 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'name': 'network-vif-deleted', 'tag': 'd7068ec0-21b9-465d-9309-774abd9482b7'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:17:55.385286 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c9c15b4-1d73-4e1e-8b4b-139af11bc1a9" -d '{"events": [{"server_uuid": "fd4c1d11-6671-41e6-aae2-b735518a3850", "name": "network-vif-deleted", "tag": "d7068ec0-21b9-465d-9309-774abd9482b7"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:17:55.484781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:17:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b24eec5b-7a49-49e6-af89-24a79555678d x-openstack-request-id: req-b24eec5b-7a49-49e6-af89-24a79555678d {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:17:55.485093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd4c1d11-6671-41e6-aae2-b735518a3850", "name": "network-vif-deleted", "tag": "d7068ec0-21b9-465d-9309-774abd9482b7", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:17:55.485329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b24eec5b-7a49-49e6-af89-24a79555678d {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:17:55.485957 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd4c1d11-6671-41e6-aae2-b735518a3850', 'name': 'network-vif-deleted', 'tag': 'd7068ec0-21b9-465d-9309-774abd9482b7', 'status': 'completed', 'code': 200} Nov 16 03:17:55.507276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-497b1a50-5450-42bf-9955-9b72ba2a8364 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.515042 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-497b1a50-5450-42bf-9955-9b72ba2a8364 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.619689 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42274) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:55.620196 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-497b1a50-5450-42bf-9955-9b72ba2a8364 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=dce0880e06e6461abce365056c197672&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7604477 Nov 16 03:17:55.621148 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-497b1a50-5450-42bf-9955-9b72ba2a8364 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=821d4ce9-4592-43d2-87cd-07034d813e86,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:55.710589 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf5c6898-b6ed-4547-9e4a-f92747cb47d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.740189 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf5c6898-b6ed-4547-9e4a-f92747cb47d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.814254 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf5c6898-b6ed-4547-9e4a-f92747cb47d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.819671 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf5c6898-b6ed-4547-9e4a-f92747cb47d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:55.830277 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-bf5c6898-b6ed-4547-9e4a-f92747cb47d2 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/821d4ce9-4592-43d2-87cd-07034d813e86 HTTP/1.1" status: 204 len: 168 time: 0.2004807 Nov 16 03:17:55.836837 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5c6898-b6ed-4547-9e4a-f92747cb47d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=821d4ce9-4592-43d2-87cd-07034d813e86,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:56.158043 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be357b7-98de-45e0-86c5-9219895df25f req-35491c45-8366-40d4-a937-fb0d454d8f69 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:56.162024 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0be357b7-98de-45e0-86c5-9219895df25f req-35491c45-8366-40d4-a937-fb0d454d8f69 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1223369 Nov 16 03:17:56.266761 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5ec47f92-4543-451e-8387-fb8caf42e8ad req-2b460c7a-bc0e-4c26-b5fb-030b4d278226 tempest-DeleteServersTestJSON-47703025 tempest-DeleteServersTestJSON-47703025-project] 10.222.0.31 "GET /v2.0/ports?device_id=fd4c1d11-6671-41e6-aae2-b735518a3850 HTTP/1.1" status: 200 len: 210 time: 0.0469856 Nov 16 03:17:56.331271 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0be357b7-98de-45e0-86c5-9219895df25f req-7dd1280d-1e14-4c11-9566-c726b0168598 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1547189 Nov 16 03:17:56.386162 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42298) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:56.411294 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f1b0d3d1-9b6a-447b-a932-e7a1ee708f61 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.536287 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42300) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:56.578523 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f1b0d3d1-9b6a-447b-a932-e7a1ee708f61 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.585414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f1b0d3d1-9b6a-447b-a932-e7a1ee708f61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.648409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f1b0d3d1-9b6a-447b-a932-e7a1ee708f61 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=84d4053b7b29491fa527cf0d71c70797&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2602961 Nov 16 03:17:56.651787 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42306) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:56.712573 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1b0d3d1-9b6a-447b-a932-e7a1ee708f61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96ba803b-86ca-47f7-a675-c94cac66fb31,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:56.791595 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26493302-0d3e-45f4-9ec7-426bd2f4a7ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.845021 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26493302-0d3e-45f4-9ec7-426bd2f4a7ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.895210 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-370352009-network', 'tenant_id': '7abc18a290264877b7cce57e27056ccf'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:56.939181 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Made reservation on behalf of 7abc18a290264877b7cce57e27056ccf for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:56.942339 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.958290 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.975243 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26493302-0d3e-45f4-9ec7-426bd2f4a7ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.980931 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-26493302-0d3e-45f4-9ec7-426bd2f4a7ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:56.981396 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-26493302-0d3e-45f4-9ec7-426bd2f4a7ab admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/96ba803b-86ca-47f7-a675-c94cac66fb31 HTTP/1.1" status: 204 len: 168 time: 0.3276577 Nov 16 03:17:57.003374 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26493302-0d3e-45f4-9ec7-426bd2f4a7ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96ba803b-86ca-47f7-a675-c94cac66fb31,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:57.169307 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.178689 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.242760 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 326} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:17:57.270458 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eaaa09dd-6539-448f-b3ed-4a46282d5242,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:57.290771 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.291433 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Added segment f570f171-eae9-4b0b-8ea1-0350983b2fe0 of type vlan for network 64a8f161-35b6-4fac-a77e-b81459bbc083 Nov 16 03:17:57.421680 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.510428 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.511883 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:57.512572 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.618306 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56ee31f5-9d0f-4e78-89e0-48b9b276c504 req-9a1c7231-cc9a-400d-9bc7-9ed252d46379 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:57.632136 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-56ee31f5-9d0f-4e78-89e0-48b9b276c504 req-9a1c7231-cc9a-400d-9bc7-9ed252d46379 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1452365 Nov 16 03:17:57.646123 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.1066120 Nov 16 03:17:57.650928 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42338) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:57.661822 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Request body: {'subnet': {'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-370352009-subnet', 'tenant_id': '7abc18a290264877b7cce57e27056ccf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:17:57.714523 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b898d88e-fa94-4997-b41a-41c5d5a7dc52 admin admin] Pushing event updated for resources: {'Network': ['ID=64a8f161-35b6-4fac-a77e-b81459bbc083,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:57.729052 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 64a8f161-35b6-4fac-a77e-b81459bbc083 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:17:57.770177 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Made reservation on behalf of 7abc18a290264877b7cce57e27056ccf for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:17:57.778741 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-128616602'] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:57.834844 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-56ee31f5-9d0f-4e78-89e0-48b9b276c504 req-db6db207-d653-487c-8e09-c93f8b7cff30 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1989360 Nov 16 03:17:58.043689 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d7068ec0-21b9-465d-9309-774abd9482b7 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:17:58.121629 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: d7068ec0-21b9-465d-9309-774abd9482b7 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:17:58.122351 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d7068ec0-21b9-465d-9309-774abd9482b7 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:17:58.286177 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-128585965', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-128616584'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:58.380742 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3f3c14a6-0800-4695-88cb-f795756f0d94,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:17:58.413584 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Checking segment: {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:17:58.414171 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Network hostable DHCP agents. Network: 64a8f161-35b6-4fac-a77e-b81459bbc083, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:17:58.438561 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Network 64a8f161-35b6-4fac-a77e-b81459bbc083 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:17:58.452633 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 64a8f161-35b6-4fac-a77e-b81459bbc083) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:17:58.460645 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:58.462890 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:17:58.463367 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c5cf978-721a-4ecb-b504-3ae8a77788f0 None None] Network 64a8f161-35b6-4fac-a77e-b81459bbc083 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:17:58.515830 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-fb2b8758-c15d-4020-8cd6-d5e1354a8f91 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8544915 Nov 16 03:17:58.689342 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81976133-489f-4fb6-80c7-999c893ed435 None None] Network 64a8f161-35b6-4fac-a77e-b81459bbc083 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:17:58.876401 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-2b66092c-5dfb-48b9-8986-970c5a9433bf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:58.881332 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-2b66092c-5dfb-48b9-8986-970c5a9433bf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.2790277 Nov 16 03:17:58.924342 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-5e2070e0-d6e4-4d4e-b575-80b2be700970 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/quotas/61a2e084639344ff8e8d5ade2eef51d0 HTTP/1.1" status: 200 len: 375 time: 0.0228927 Nov 16 03:17:59.086121 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-05b4a4f9-46d5-4980-b1fa-3d173f12f58e tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1544232 Nov 16 03:17:59.109303 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb82e04e-6f2a-48ef-91d3-ff733c27826d req-9c5391fe-30ea-4f1a-91a0-765d886f62d0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:17:59.118120 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cb82e04e-6f2a-48ef-91d3-ff733c27826d req-9c5391fe-30ea-4f1a-91a0-765d886f62d0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1101191 Nov 16 03:17:59.298666 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cb82e04e-6f2a-48ef-91d3-ff733c27826d req-8be709cc-d00d-4c88-b2aa-bd4496fca48d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1788754 Nov 16 03:17:59.327728 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-adc0769c-4755-4715-bfba-bc56b7b3b6d6 service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2403233 Nov 16 03:17:59.514862 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-490f9d18-8f07-4288-9f95-f7b47371d760 service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1807089 Nov 16 03:17:59.771181 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f90dddbc-ef7c-40f3-b617-45966dcaf409 req-48802a70-a402-40a2-ba99-09338249e8f1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 210 time: 0.0478928 Nov 16 03:17:59.894544 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42434) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:17:59.910215 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42440) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:00.016362 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_v2 [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Deleting subnet 62a9a221-1e05-4212-8fa0-766d2a72e114 {{(pid=101899) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:18:00.022009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.103366 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.117240 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.157903 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0e802cdc-3909-438f-9da6-99517aa54493 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.171451 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-da001b7e-c552-4f83-960d-55713d8a323b service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1102805 Nov 16 03:18:00.228484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for subnet, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.297196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=62a9a221-1e05-4212-8fa0-766d2a72e114,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:00.313907 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.320997 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-68a5ad34-6d87-4803-9b10-eeeea4d9ed1d admin admin] 10.222.0.31 "DELETE /v2.0/subnets/62a9a221-1e05-4212-8fa0-766d2a72e114 HTTP/1.1" status: 204 len: 168 time: 0.4095726 Nov 16 03:18:00.321813 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42450) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:00.361871 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0e802cdc-3909-438f-9da6-99517aa54493 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.366286 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42452) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:00.384028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0e802cdc-3909-438f-9da6-99517aa54493 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.605381 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-0e802cdc-3909-438f-9da6-99517aa54493 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=965e71aba7544114b60f041e6202b694&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6882401 Nov 16 03:18:00.606935 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42462) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:00.611610 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e802cdc-3909-438f-9da6-99517aa54493 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb65658f-a3aa-4a1c-a35a-04919220cf6d,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:00.707517 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d203f36c-2451-4a5b-8225-16c12208c06b req-9a205a80-e7f5-411e-8ac5-5b00ff851e25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:00.709147 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-9a205a80-e7f5-411e-8ac5-5b00ff851e25 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 1099 time: 0.4076972 Nov 16 03:18:00.720397 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.741198 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b2e32d-f135-4dbd-9228-bc73512bcecd req-3e021433-657f-4692-b481-a559deb86c3d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:00.743368 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8b2e32d-f135-4dbd-9228-bc73512bcecd req-3e021433-657f-4692-b481-a559deb86c3d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.0930979 Nov 16 03:18:00.848341 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83c52834-ebbe-4459-9152-d3b718c1f76d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.896503 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b8e12611-85d1-4e90-9c06-96d38981fe73 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:00.951738 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b8e12611-85d1-4e90-9c06-96d38981fe73 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.006176 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8b2e32d-f135-4dbd-9228-bc73512bcecd req-3fafbe9d-41be-46c7-9a22-611b1e895112 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2399817 Nov 16 03:18:01.012734 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.105027 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b8e12611-85d1-4e90-9c06-96d38981fe73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.154811 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b8e12611-85d1-4e90-9c06-96d38981fe73 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.161723 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b8e12611-85d1-4e90-9c06-96d38981fe73 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/bb65658f-a3aa-4a1c-a35a-04919220cf6d HTTP/1.1" status: 204 len: 168 time: 0.5447655 Nov 16 03:18:01.222136 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8aa90d6f-e43a-44d8-bd79-88d6220bd110 req-9eb2d551-9673-484e-b332-cd422c90fda7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 210 time: 0.1227238 Nov 16 03:18:01.225272 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e12611-85d1-4e90-9c06-96d38981fe73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb65658f-a3aa-4a1c-a35a-04919220cf6d,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:01.236010 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.236677 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.238692 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.240022 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > port after_create 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.240643 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > port after_delete 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.241257 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > port after_update 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.241881 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.242470 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.243275 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.243889 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.428182 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.428500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83c52834-ebbe-4459-9152-d3b718c1f76d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.428764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.429206 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.429727 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101899) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 16 03:18:01.430329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f95bded8-2028-40ca-9071-70ff49c6a60c']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:18:01.438698 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83c52834-ebbe-4459-9152-d3b718c1f76d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.502311 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c87f961f-876c-4440-87a5-a87de8e1b0b6') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:18:01.502746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c87f961f-876c-4440-87a5-a87de8e1b0b6') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:18:01.542325 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-83c52834-ebbe-4459-9152-d3b718c1f76d admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d2568b7f18c247399110e4205b42da66&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1738610 Nov 16 03:18:01.569820 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42492) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:01.571109 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c52834-ebbe-4459-9152-d3b718c1f76d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=933b3ee4-307b-4601-a901-2e0e6c1dab14,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:01.624935 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.633620 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d203f36c-2451-4a5b-8225-16c12208c06b req-b3df1b1f-47f4-44be-9a74-2852d59a9757 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:01.635588 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-b3df1b1f-47f4-44be-9a74-2852d59a9757 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 915 time: 0.8836210 Nov 16 03:18:01.710587 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d611c552-b0eb-486d-a1d2-5236f7e2fa26 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.720797 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-c5f9c5e8-52a0-4e82-9b28-0dfb10379c1e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db HTTP/1.1" status: 200 len: 217 time: 0.0728772 Nov 16 03:18:01.722288 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.765242 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d611c552-b0eb-486d-a1d2-5236f7e2fa26 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.783728 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Releasing vlan 321 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:18:01.784494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: from cryptography.utils import int_from_bytes Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: from cryptography.utils import int_from_bytes Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:18:01.791066 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:18:01.866418 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-5d7549c2-e44f-4f53-86d9-4351693d70fd tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:01.875049 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-5d7549c2-e44f-4f53-86d9-4351693d70fd tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/networks?id=64a8f161-35b6-4fac-a77e-b81459bbc083 HTTP/1.1" status: 200 len: 808 time: 0.4298916 Nov 16 03:18:01.876012 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d611c552-b0eb-486d-a1d2-5236f7e2fa26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.885127 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d611c552-b0eb-486d-a1d2-5236f7e2fa26 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:01.890152 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d611c552-b0eb-486d-a1d2-5236f7e2fa26 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/933b3ee4-307b-4601-a901-2e0e6c1dab14 HTTP/1.1" status: 204 len: 168 time: 0.3065279 Nov 16 03:18:01.905300 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d611c552-b0eb-486d-a1d2-5236f7e2fa26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=933b3ee4-307b-4601-a901-2e0e6c1dab14,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:01.925110 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-96e93117-0728-4399-8e73-6efbbd74bc6b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/quotas/7abc18a290264877b7cce57e27056ccf HTTP/1.1" status: 200 len: 375 time: 0.0485475 Nov 16 03:18:01.928216 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d203f36c-2451-4a5b-8225-16c12208c06b req-d1050b9d-9dfc-44c8-9f36-2c5d8eb0b731 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:01.929981 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-d1050b9d-9dfc-44c8-9f36-2c5d8eb0b731 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.1946673 Nov 16 03:18:01.973773 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:02.004961 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-9a125d24-3f53-4458-aa91-087daf37e934 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=7abc18a290264877b7cce57e27056ccf&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0785332 Nov 16 03:18:02.016346 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-5518574e-8820-4ff4-bde5-f0838cb26a86 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0734198 Nov 16 03:18:02.041801 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:02.050862 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] 10.222.0.31 "DELETE /v2.0/networks/f95bded8-2028-40ca-9071-70ff49c6a60c HTTP/1.1" status: 204 len: 168 time: 1.7129927 Nov 16 03:18:02.104403 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba25170c-cc05-4d3f-b986-d291c8c2ffc6 admin admin] Pushing event deleted for resources: {'Network': ['ID=f95bded8-2028-40ca-9071-70ff49c6a60c,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:02.259456 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-8a95ba50-98bd-4791-a673-0de00ea4b46d service neutron] 10.222.0.31 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2531090 Nov 16 03:18:02.341978 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-17506df0-26f1-4f90-9bdf-327510142b53 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2896607 Nov 16 03:18:02.357795 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b44dd17-4f8d-4492-adfd-3faa63c5ff71 req-8b09a619-bb32-4739-8952-58f0dd338ffd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:02.359461 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6b44dd17-4f8d-4492-adfd-3faa63c5ff71 req-8b09a619-bb32-4739-8952-58f0dd338ffd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1843553 Nov 16 03:18:02.444210 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42518) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:02.551752 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-79e33b03-b52d-44f1-b4ea-3dddc68e07d9 service neutron] 10.222.0.31 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2913296 Nov 16 03:18:02.597844 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6b44dd17-4f8d-4492-adfd-3faa63c5ff71 req-7a16545b-ab96-4aa2-8dbb-7dd8b87c9fa2 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2201982 Nov 16 03:18:02.614541 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d42bc730-834e-4e42-9375-17508d1bd2f3 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b9840e08acad4f96a65962ff11498530&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1661947 Nov 16 03:18:02.623189 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42528) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:02.649550 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d203f36c-2451-4a5b-8225-16c12208c06b req-9dc8e016-a090-4b2f-b18a-67fa21efb7aa service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2801683 Nov 16 03:18:02.712820 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-1a1f5212-ec3c-4e53-b9cc-e11150608bf8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:02.719552 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-1a1f5212-ec3c-4e53-b9cc-e11150608bf8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.5894716 Nov 16 03:18:02.783643 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Request body: {'port': {'device_id': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'admin_state_up': True, 'tenant_id': '61a2e084639344ff8e8d5ade2eef51d0'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:02.887106 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-083fe391-5488-41d6-b923-a6c880d4fbe2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:02.895447 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1bb4ee39-7f11-4b10-9cbe-20ccc1f9fbde req-66d9bcd5-2eb6-4f03-a113-07ab40dbcb60 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 210 time: 0.1372435 Nov 16 03:18:02.900225 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42538) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:02.940186 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5c2a512-e070-429a-a75a-7947815536bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:02.972827 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-083fe391-5488-41d6-b923-a6c880d4fbe2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:02.995874 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-42195515-72fd-4b0f-afe0-832359b9b09d req-6894d448-e226-4c29-8176-2f2062c98de5 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 210 time: 0.0914099 Nov 16 03:18:03.149817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Made reservation on behalf of 61a2e084639344ff8e8d5ade2eef51d0 for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:18:03.156362 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.199490 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-083fe391-5488-41d6-b923-a6c880d4fbe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.202627 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-083fe391-5488-41d6-b923-a6c880d4fbe2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.207339 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-083fe391-5488-41d6-b923-a6c880d4fbe2 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/cc2b27c1-d719-401a-85be-f411edde75d4 HTTP/1.1" status: 204 len: 168 time: 0.5813529 Nov 16 03:18:03.281351 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083fe391-5488-41d6-b923-a6c880d4fbe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc2b27c1-d719-401a-85be-f411edde75d4,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:03.285071 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5c2a512-e070-429a-a75a-7947815536bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.297047 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5c2a512-e070-429a-a75a-7947815536bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.412020 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c5c2a512-e070-429a-a75a-7947815536bd admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b3f2fbb77f944fd9ae1f99a69d2183b5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5106807 Nov 16 03:18:03.416347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42552) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:03.432337 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c2a512-e070-429a-a75a-7947815536bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c705ea88-111e-4740-97b0-af9dcdd57746,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:03.513878 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Allocated IP 172.20.0.2 (9a8436ad-09c6-4a61-8922-e3cc29d73f78/a3fb04df-83c0-4d51-afa7-1e0694c8dbc3/da96bbab-7015-473b-bb68-ef95db66868f) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:18:03.585040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68f4940d-d177-415c-8e61-6d9bcd9a6749 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.639167 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68f4940d-d177-415c-8e61-6d9bcd9a6749 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.860866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.916178 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68f4940d-d177-415c-8e61-6d9bcd9a6749 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.919950 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-68f4940d-d177-415c-8e61-6d9bcd9a6749 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.921683 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-68f4940d-d177-415c-8e61-6d9bcd9a6749 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c705ea88-111e-4740-97b0-af9dcdd57746 HTTP/1.1" status: 204 len: 168 time: 0.5040863 Nov 16 03:18:03.953057 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc59fb8-77e0-43fb-a405-70ba3b4e0f6d req-21f43859-0218-402e-ac06-f62b8a16b1b5 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:03.989180 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fc59fb8-77e0-43fb-a405-70ba3b4e0f6d req-21f43859-0218-402e-ac06-f62b8a16b1b5 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.2633960 Nov 16 03:18:03.989392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:03.997263 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f4940d-d177-415c-8e61-6d9bcd9a6749 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c705ea88-111e-4740-97b0-af9dcdd57746,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:04.086326 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:04.183249 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fc59fb8-77e0-43fb-a405-70ba3b4e0f6d req-90ee2a31-0fc6-492c-95f0-b8df5066a096 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1899879 Nov 16 03:18:04.185029 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:18:04.186065 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event updated for resources: {'Port': ['ID=da96bbab-7015-473b-bb68-ef95db66868f,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:04.197417 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:18:04.214578 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:18:04.342607 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620c3fdc-41cb-4cf4-9317-f15fadb34469 req-64a04f69-df39-421a-ab0c-90ee45fb2712 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:04.347361 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-620c3fdc-41cb-4cf4-9317-f15fadb34469 req-64a04f69-df39-421a-ab0c-90ee45fb2712 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 931 time: 0.1156297 Nov 16 03:18:04.483752 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:04.484850 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:04.518621 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-4c4aa131-fc05-4ade-8f9c-5d365c75b96c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7393675 Nov 16 03:18:04.544886 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Request body: {'port': {'device_id': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:04.582521 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e03db686-d121-4966-bf4c-948b854dc794 req-95dd3f7b-277a-475d-9210-0ded98fa6082 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 210 time: 0.0491934 Nov 16 03:18:04.595311 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-620c3fdc-41cb-4cf4-9317-f15fadb34469 req-cd59f5e4-8c41-4963-ba27-dae18d696cb7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2332749 Nov 16 03:18:04.648108 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:04.873817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42596) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:04.905143 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d6d52149-93be-4cef-aa1a-fe665f4150de admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.013616 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da96bbab-7015-473b-bb68-ef95db66868f {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:05.030244 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.047797 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Transition to ACTIVE for port object da96bbab-7015-473b-bb68-ef95db66868f will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:18:05.056275 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.136021 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Pushing event updated for resources: {'Port': ['ID=da96bbab-7015-473b-bb68-ef95db66868f,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:05.184272 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d6d52149-93be-4cef-aa1a-fe665f4150de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.206925 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d6d52149-93be-4cef-aa1a-fe665f4150de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.246720 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d52149-93be-4cef-aa1a-fe665f4150de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c71c6ebb-09cd-43f8-9fc5-91d565f0ab96,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:05.275132 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d6d52149-93be-4cef-aa1a-fe665f4150de admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d5d76151f3014a71b93060f37db77e00&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4000795 Nov 16 03:18:05.279567 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42608) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:05.343178 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Attempting to bind port da96bbab-7015-473b-bb68-ef95db66868f on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:18:05.343706 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Attempting to bind port da96bbab-7015-473b-bb68-ef95db66868f by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:18:05.344212 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Attempting to bind port da96bbab-7015-473b-bb68-ef95db66868f on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:05.357924 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Port da96bbab-7015-473b-bb68-ef95db66868f on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:18:05.369341 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Attempting to bind port da96bbab-7015-473b-bb68-ef95db66868f on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:05.378518 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 17, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:18:05.382589 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Checking segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:18:05.384934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Bound using segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:18:05.387431 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Bound port: da96bbab-7015-473b-bb68-ef95db66868f, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:18:05.387936 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.457718 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-146e2ff4-1929-4bfc-adc0-a3296046e2a0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.513800 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-146e2ff4-1929-4bfc-adc0-a3296046e2a0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.527844 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-f63f5de2-67aa-4c7d-a160-badc3b7bc9a5 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:05.530296 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-f63f5de2-67aa-4c7d-a160-badc3b7bc9a5 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "GET /v2.0/networks?id=64a8f161-35b6-4fac-a77e-b81459bbc083 HTTP/1.1" status: 200 len: 808 time: 0.3750389 Nov 16 03:18:05.554143 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] For port da96bbab-7015-473b-bb68-ef95db66868f, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:18:05.558298 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8fe31c-1dc0-412b-abee-e9d0cf1a67c8 req-161000d8-cab2-4c21-94a4-54d749690856 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:05.572560 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2a8fe31c-1dc0-412b-abee-e9d0cf1a67c8 req-161000d8-cab2-4c21-94a4-54d749690856 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1367648 Nov 16 03:18:05.579202 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] For port da96bbab-7015-473b-bb68-ef95db66868f, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=da96bbab-7015-473b-bb68-ef95db66868f,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:18:05.590371 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.600550 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Request body: {'port': {'device_id': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083', 'admin_state_up': True, 'tenant_id': '7abc18a290264877b7cce57e27056ccf'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:05.645611 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-146e2ff4-1929-4bfc-adc0-a3296046e2a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.648913 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-146e2ff4-1929-4bfc-adc0-a3296046e2a0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.658089 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-146e2ff4-1929-4bfc-adc0-a3296046e2a0 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c71c6ebb-09cd-43f8-9fc5-91d565f0ab96 HTTP/1.1" status: 204 len: 168 time: 0.3731079 Nov 16 03:18:05.658089 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:05.658089 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.659266 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] 10.222.0.11 "PUT /v2.0/ports/da96bbab-7015-473b-bb68-ef95db66868f HTTP/1.1" status: 200 len: 1093 time: 1.1216421 Nov 16 03:18:05.671315 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'tag': 'da96bbab-7015-473b-bb68-ef95db66868f'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:05.674299 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e" -d '{"events": [{"name": "network-changed", "server_uuid": "420fb8d2-4f97-4506-838c-080e5a17d65f", "tag": "da96bbab-7015-473b-bb68-ef95db66868f"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:05.722233 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146e2ff4-1929-4bfc-adc0-a3296046e2a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c71c6ebb-09cd-43f8-9fc5-91d565f0ab96,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:05.797686 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.850079 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2a8fe31c-1dc0-412b-abee-e9d0cf1a67c8 req-a2bf8e9d-270a-4de3-991b-d9e2d4db340e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2707503 Nov 16 03:18:05.859506 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b57c79d3-a2f5-4137-ab69-03552f41a40e service neutron] Pushing event updated for resources: {'Port': ['ID=da96bbab-7015-473b-bb68-ef95db66868f,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:05.865450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42636) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:05.894793 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Made reservation on behalf of 7abc18a290264877b7cce57e27056ccf for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:18:05.898877 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:05.926364 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-c54beb1a-fba6-4f81-839e-215f7ed3f4eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:05.928527 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-c54beb1a-fba6-4f81-839e-215f7ed3f4eb service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 1096 time: 0.1724758 Nov 16 03:18:05.961374 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a1f0f359-f453-43f2-a476-083e1a428b68 req-387aa766-f4d8-44bc-ab0e-4a6950341e41 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 210 time: 0.0431957 Nov 16 03:18:06.039865 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-59f58975-45f5-4c07-87ce-035898de2b46 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=da96bbab-7015-473b-bb68-ef95db66868f HTTP/1.1" status: 200 len: 217 time: 0.0894465 Nov 16 03:18:06.086489 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9ca3fa34-ed49-4466-b72c-2056c0fc76c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:06.139509 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-69481ede-af9c-4f56-bb20-93a44e4af21a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:06.141573 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-69481ede-af9c-4f56-bb20-93a44e4af21a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.0877926 Nov 16 03:18:06.195814 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-eca07480-be04-48ed-90b8-158247e054cc service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0466285 Nov 16 03:18:06.215265 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01304ebe-f2cd-4614-88ab-c43b9a27c2f4 req-d0ab682a-bb60-47a5-bb4a-d04d4bfc48d5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:06.216989 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-01304ebe-f2cd-4614-88ab-c43b9a27c2f4 req-d0ab682a-bb60-47a5-bb4a-d04d4bfc48d5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 943 time: 0.1349218 Nov 16 03:18:06.240903 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Allocated IP 172.20.0.8 (64a8f161-35b6-4fac-a77e-b81459bbc083/3f3c14a6-0800-4695-88cb-f795756f0d94/fae71ce4-f0f2-4467-add7-7d08fa21f400) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:18:06.354948 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-25dc0d7e-2f79-433d-8902-a8c60255f042 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1500106 Nov 16 03:18:06.361365 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9ca3fa34-ed49-4466-b72c-2056c0fc76c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:06.376752 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-01304ebe-f2cd-4614-88ab-c43b9a27c2f4 req-1dcdafc2-01bc-4a25-8771-c123f195720c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1392539 Nov 16 03:18:06.389250 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9ca3fa34-ed49-4466-b72c-2056c0fc76c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:06.463142 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-689efefb-074b-4537-b5ed-b3fd74f5d140 x-openstack-request-id: req-689efefb-074b-4537-b5ed-b3fd74f5d140 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:06.463438 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "420fb8d2-4f97-4506-838c-080e5a17d65f", "tag": "da96bbab-7015-473b-bb68-ef95db66868f", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:06.463687 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-689efefb-074b-4537-b5ed-b3fd74f5d140 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:06.464090 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'tag': 'da96bbab-7015-473b-bb68-ef95db66868f', 'status': 'completed', 'code': 200} Nov 16 03:18:06.569816 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-9ca3fa34-ed49-4466-b72c-2056c0fc76c9 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=57e49859784c40d9aefb271293dbec1c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7018318 Nov 16 03:18:06.576405 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42660) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:06.577504 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ca3fa34-ed49-4466-b72c-2056c0fc76c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fa2587e-0381-48fc-96b5-7627ee6d35af,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:06.597071 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-da6a8931-c168-40bf-b88d-e7e578f1cd60 req-e63562b5-4646-48ea-8cd7-1343883c8f75 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2337337 Nov 16 03:18:06.764627 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-412cb5e0-4db3-40e8-a7ef-50d5be1ae3b7 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=9dd17d33e39d4d719a978fe26d5ccb1d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1173143 Nov 16 03:18:06.788028 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:06.798971 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-1bc39064-0112-4185-95ef-7b90c58e4bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:06.802041 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-1bc39064-0112-4185-95ef-7b90c58e4bd9 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 1096 time: 0.0634696 Nov 16 03:18:06.969277 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-94af5fca-0217-4c9d-9ea1-417965303c22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:06.972027 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-94af5fca-0217-4c9d-9ea1-417965303c22 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 915 time: 0.1521370 Nov 16 03:18:07.027018 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-ecccfc85-4eab-4197-aa18-721edbf99c96 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=da96bbab-7015-473b-bb68-ef95db66868f HTTP/1.1" status: 200 len: 217 time: 0.0470691 Nov 16 03:18:07.098691 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-731d50a7-ab49-435b-92d0-bc205a13311d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:07.101286 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-731d50a7-ab49-435b-92d0-bc205a13311d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.0605152 Nov 16 03:18:07.142363 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-8234ed5d-75f4-44b5-a114-f19beeecebcc service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315073 Nov 16 03:18:07.162904 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-bedeca4f-339f-4d04-b2f2-69aafc411c28 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.282881 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-bedeca4f-339f-4d04-b2f2-69aafc411c28 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.313660 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-17191ac8-20bb-4694-ad10-bc083c77cc96 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1595733 Nov 16 03:18:07.349466 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66d77897-c23a-4931-a97a-abf633cb7014 req-4b9d7a6f-3674-4b3b-a2c5-cb14578b1c2c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:07.354446 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-66d77897-c23a-4931-a97a-abf633cb7014 req-4b9d7a6f-3674-4b3b-a2c5-cb14578b1c2c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.3064687 Nov 16 03:18:07.357596 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.438816 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-84e28c7d-6988-4758-a9ce-f9105ff6dce6 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:07.446080 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-84e28c7d-6988-4758-a9ce-f9105ff6dce6 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6819732 Nov 16 03:18:07.453148 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ef5b99b2-3055-4ada-b4bc-6da3bd9ac39e req-bbdcf4bf-1e3f-49b0-a8d0-ef8084f2f6e8 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1298711 Nov 16 03:18:07.518850 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Network 64a8f161-35b6-4fac-a77e-b81459bbc083 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:18:07.530603 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Pushing event updated for resources: {'Port': ['ID=fae71ce4-f0f2-4467-add7-7d08fa21f400,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:07.539009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:18:07.541531 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-83c1662c-cdb2-4e8a-a7ef-4ba91937c2c8 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/quotas/9dd17d33e39d4d719a978fe26d5ccb1d HTTP/1.1" status: 200 len: 375 time: 0.0699987 Nov 16 03:18:07.548641 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:18:07.557555 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-66d77897-c23a-4931-a97a-abf633cb7014 req-79089acc-6dc1-44b8-b950-f2520b6dbc80 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1900020 Nov 16 03:18:07.635507 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-bedeca4f-339f-4d04-b2f2-69aafc411c28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.635934 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-bedeca4f-339f-4d04-b2f2-69aafc411c28 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.637211 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-bedeca4f-339f-4d04-b2f2-69aafc411c28 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7fa2587e-0381-48fc-96b5-7627ee6d35af HTTP/1.1" status: 204 len: 168 time: 1.0545242 Nov 16 03:18:07.644600 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-7af414a2-ef28-4314-926c-dae69b2cac60 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=9dd17d33e39d4d719a978fe26d5ccb1d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0561588 Nov 16 03:18:07.695890 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:07.696943 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.709352 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bedeca4f-339f-4d04-b2f2-69aafc411c28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fa2587e-0381-48fc-96b5-7627ee6d35af,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:07.781134 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-6a837352-cfa8-43dc-b9ff-c959867dc9a4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1860061 Nov 16 03:18:07.806685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Request body: {'port': {'device_id': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:07.818574 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7195e5b-9496-476a-92a2-e21426915831 req-5cc45f0e-6147-44cf-9cf1-0ad5579d2c4b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:07.820369 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7195e5b-9496-476a-92a2-e21426915831 req-5cc45f0e-6147-44cf-9cf1-0ad5579d2c4b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 931 time: 0.1083708 Nov 16 03:18:07.939248 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:07.963923 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7195e5b-9496-476a-92a2-e21426915831 req-b908f439-9c99-4603-8c7f-1962469791df tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075377 Nov 16 03:18:08.391861 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5277acb-6bfb-446c-aa67-acca9b146d04 req-5bbe6b34-9ba5-4f48-9195-2ee486d529b2 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0813758 Nov 16 03:18:08.396136 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42716) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:08.421998 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-414dd312-3c60-479c-9a46-aab79d4f2466 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:08.476826 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da516e0-98b9-4554-bea5-254fd2b0c362 req-7d860937-73c4-4abc-b7da-1c5751206de0 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:08.489415 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3da516e0-98b9-4554-bea5-254fd2b0c362 req-7d860937-73c4-4abc-b7da-1c5751206de0 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 943 time: 0.2932200 Nov 16 03:18:08.631817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-414dd312-3c60-479c-9a46-aab79d4f2466 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:08.632483 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3da516e0-98b9-4554-bea5-254fd2b0c362 req-4c4b9d8d-d5c3-4516-b0a8-19fabac5ce3c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1413987 Nov 16 03:18:08.640994 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-414dd312-3c60-479c-9a46-aab79d4f2466 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:08.717066 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fae71ce4-f0f2-4467-add7-7d08fa21f400 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:08.728579 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:08.750785 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Transition to ACTIVE for port object fae71ce4-f0f2-4467-add7-7d08fa21f400 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:18:08.752409 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-414dd312-3c60-479c-9a46-aab79d4f2466 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c782fb4-80bd-437d-9c6a-3d13dc8fcbe1,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:08.760721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:08.764822 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-414dd312-3c60-479c-9a46-aab79d4f2466 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=39e4bc64d2e3484d964d9e2eaf402e04&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3670020 Nov 16 03:18:08.768692 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42728) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:08.926016 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Pushing event updated for resources: {'Port': ['ID=fae71ce4-f0f2-4467-add7-7d08fa21f400,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:08.947850 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-17e34862-7860-4da3-b287-83f075c79fa0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.003699 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-17e34862-7860-4da3-b287-83f075c79fa0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.050444 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e92b6c4-d192-46d1-afac-cde3971e54dd req-3fe4fcf5-eb03-4be6-9170-fbba2af6ee50 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:09.058161 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4e92b6c4-d192-46d1-afac-cde3971e54dd req-3fe4fcf5-eb03-4be6-9170-fbba2af6ee50 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.2104304 Nov 16 03:18:09.129268 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Attempting to bind port fae71ce4-f0f2-4467-add7-7d08fa21f400 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:18:09.129736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Attempting to bind port fae71ce4-f0f2-4467-add7-7d08fa21f400 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:18:09.130104 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Attempting to bind port fae71ce4-f0f2-4467-add7-7d08fa21f400 on network 64a8f161-35b6-4fac-a77e-b81459bbc083 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:09.143900 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4e92b6c4-d192-46d1-afac-cde3971e54dd req-81041c8a-e86f-418c-9f56-aed6b933bb61 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845854 Nov 16 03:18:09.147387 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-17e34862-7860-4da3-b287-83f075c79fa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.153296 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-17e34862-7860-4da3-b287-83f075c79fa0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.155676 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-17e34862-7860-4da3-b287-83f075c79fa0 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9c782fb4-80bd-437d-9c6a-3d13dc8fcbe1 HTTP/1.1" status: 204 len: 168 time: 0.3829286 Nov 16 03:18:09.158683 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Port fae71ce4-f0f2-4467-add7-7d08fa21f400 on network 64a8f161-35b6-4fac-a77e-b81459bbc083 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:18:09.159688 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Attempting to bind port fae71ce4-f0f2-4467-add7-7d08fa21f400 on network 64a8f161-35b6-4fac-a77e-b81459bbc083 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:09.167061 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 18, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:18:09.167879 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Checking segment: {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:18:09.168749 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Bound using segment: {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:18:09.169564 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Bound port: fae71ce4-f0f2-4467-add7-7d08fa21f400, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:18:09.170165 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.205964 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e34862-7860-4da3-b287-83f075c79fa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c782fb4-80bd-437d-9c6a-3d13dc8fcbe1,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:09.433009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4d5696-380f-45f9-b563-53de5a257f8c req-bb6c96f6-951d-40a4-a0b1-76d2d214a8c1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:09.445772 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef4d5696-380f-45f9-b563-53de5a257f8c req-bb6c96f6-951d-40a4-a0b1-76d2d214a8c1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 943 time: 0.1730304 Nov 16 03:18:09.478857 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] For port fae71ce4-f0f2-4467-add7-7d08fa21f400, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:18:09.509407 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] For port fae71ce4-f0f2-4467-add7-7d08fa21f400, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:18:09.528767 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.662463 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-36ae2ce1-9f85-47df-ac38-bede8ec14365 req-95891b00-8d78-413a-84be-ef913e6ff61d tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0657496 Nov 16 03:18:09.704949 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef4d5696-380f-45f9-b563-53de5a257f8c req-13e1f5c9-8b0c-4860-83fc-3d9571dae464 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2576632 Nov 16 03:18:09.733495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:09.733495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:09.735527 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] 10.222.0.11 "PUT /v2.0/ports/fae71ce4-f0f2-4467-add7-7d08fa21f400 HTTP/1.1" status: 200 len: 1093 time: 1.9356308 Nov 16 03:18:09.736245 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'tag': 'fae71ce4-f0f2-4467-add7-7d08fa21f400'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:09.740567 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8482d592-2ab5-41fe-8818-a9cac5a1967a" -d '{"events": [{"name": "network-changed", "server_uuid": "46658c04-ab20-40ea-a4e6-c03fc64b2caf", "tag": "fae71ce4-f0f2-4467-add7-7d08fa21f400"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:09.816425 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf8b941-ef6c-42be-abd9-b1fa68393506 service neutron] Pushing event updated for resources: {'Port': ['ID=fae71ce4-f0f2-4467-add7-7d08fa21f400,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:09.867081 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d556cfd-4de6-40ef-b6dc-f0b964ef828e x-openstack-request-id: req-7d556cfd-4de6-40ef-b6dc-f0b964ef828e {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:09.867382 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "46658c04-ab20-40ea-a4e6-c03fc64b2caf", "tag": "fae71ce4-f0f2-4467-add7-7d08fa21f400", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:09.867737 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-7d556cfd-4de6-40ef-b6dc-f0b964ef828e {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:09.868148 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'tag': 'fae71ce4-f0f2-4467-add7-7d08fa21f400', 'status': 'completed', 'code': 200} Nov 16 03:18:09.946444 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9187ca-a74b-48a2-830c-76a4d7b89de8 req-b7f65056-99a6-4873-92db-f6df7755dfb3 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:09.955165 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd9187ca-a74b-48a2-830c-76a4d7b89de8 req-b7f65056-99a6-4873-92db-f6df7755dfb3 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 943 time: 0.1320941 Nov 16 03:18:09.974743 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-63f9687a-a4b9-4e4e-a2ad-ffc4cd0e9563 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:09.974743 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-63f9687a-a4b9-4e4e-a2ad-ffc4cd0e9563 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7abc18a290264877b7cce57e27056ccf&device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 1096 time: 0.1403356 Nov 16 03:18:10.084462 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-f7b12b42-0350-432b-b36b-99f8ed04ad45 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400 HTTP/1.1" status: 200 len: 217 time: 0.0894096 Nov 16 03:18:10.144087 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device da96bbab-7015-473b-bb68-ef95db66868f details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:18:10.165988 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd9187ca-a74b-48a2-830c-76a4d7b89de8 req-2e23519d-4fff-4324-b712-7519d483d230 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2091827 Nov 16 03:18:10.217251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-86dfb213-5f76-42f6-b8f5-930b5df9c00c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:10.224162 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-86dfb213-5f76-42f6-b8f5-930b5df9c00c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3f3c14a6-0800-4695-88cb-f795756f0d94 HTTP/1.1" status: 200 len: 848 time: 0.1287053 Nov 16 03:18:10.331472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-bd2c109e-a369-4faf-8d34-7803e7b8ee65 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=64a8f161-35b6-4fac-a77e-b81459bbc083&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0987136 Nov 16 03:18:10.360498 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port da96bbab-7015-473b-bb68-ef95db66868f, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=da96bbab-7015-473b-bb68-ef95db66868f,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:10.377937 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'da96bbab-7015-473b-bb68-ef95db66868f', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'port_id': 'da96bbab-7015-473b-bb68-ef95db66868f', 'mac_address': 'fa:16:3e:28:cc:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 327, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3fb04df-83c0-4d51-afa7-1e0694c8dbc3', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:18:10.530212 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-c006bdd1-cd3f-46e5-bc17-fd500bc56594 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=9dd17d33e39d4d719a978fe26d5ccb1d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1136837 Nov 16 03:18:10.531824 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:10.589890 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da96bbab-7015-473b-bb68-ef95db66868f {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:10.651706 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd31744d-187f-495f-a86b-e415bb784155 req-88735052-62e2-4070-adec-af761e863a11 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:10.659244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd31744d-187f-495f-a86b-e415bb784155 req-88735052-62e2-4070-adec-af761e863a11 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.3429878 Nov 16 03:18:10.662893 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port da96bbab-7015-473b-bb68-ef95db66868f, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=da96bbab-7015-473b-bb68-ef95db66868f,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:10.676433 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:10.838867 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-e4ea2eb4-66ee-4b72-b949-bbd7939d854c service neutron] 10.222.0.11 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4893014 Nov 16 03:18:10.910476 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=da96bbab-7015-473b-bb68-ef95db66868f,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:10.923578 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.924469 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.925400 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.925896 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.927364 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.928125 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.928831 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.929517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.930200 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.930911 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.931612 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:10.932264 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:18:11.037718 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42808) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:11.101026 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['da96bbab-7015-473b-bb68-ef95db66868f'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:11.112328 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d06abb4a-09e9-4e1b-b295-953113049704 req-b17ec23c-30f4-4f35-a2db-c1986c59e7c2 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0772016 Nov 16 03:18:11.167067 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-a0610eb4-47dd-409e-aabe-4e3802d39d11 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:11.178250 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-a0610eb4-47dd-409e-aabe-4e3802d39d11 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6318750 Nov 16 03:18:11.180104 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd31744d-187f-495f-a86b-e415bb784155 req-c7438343-cf95-437b-9e41-9b428dc4aab8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5065718 Nov 16 03:18:11.192595 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c957e0a4-d900-4b7e-9b17-44e093cd0a15 req-a8b32e6b-e842-44e7-b74a-afab458314de service neutron] 10.222.0.11 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3403716 Nov 16 03:18:11.203570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Request body: {'port': {'device_id': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77', 'admin_state_up': True, 'tenant_id': '9dd17d33e39d4d719a978fe26d5ccb1d'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:11.316314 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f60c75c-d78d-4ba3-847f-4581fc97fe00 req-0f2a6b4f-1892-4bf6-921f-8a921925a56c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:11.326872 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f60c75c-d78d-4ba3-847f-4581fc97fe00 req-0f2a6b4f-1892-4bf6-921f-8a921925a56c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 943 time: 0.0920095 Nov 16 03:18:11.475581 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-d54b7aac-af41-4d10-a290-fcc07a6fe4dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:11.478832 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-d54b7aac-af41-4d10-a290-fcc07a6fe4dd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7abc18a290264877b7cce57e27056ccf&device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 1096 time: 0.1280115 Nov 16 03:18:11.501180 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f60c75c-d78d-4ba3-847f-4581fc97fe00 req-9793fc46-a495-4675-8bed-f59d4bcd96d0 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1719685 Nov 16 03:18:11.635263 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Made reservation on behalf of 9dd17d33e39d4d719a978fe26d5ccb1d for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:18:11.641313 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:11.664729 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:11.668746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ebcc27-1433-440b-9838-fed3bc055a66 req-edcfe5ca-2015-457a-a330-d4a6c38a47e7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:11.675505 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-79ebcc27-1433-440b-9838-fed3bc055a66 req-edcfe5ca-2015-457a-a330-d4a6c38a47e7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 944 time: 0.2638583 Nov 16 03:18:11.761267 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-5ba62d6a-2661-4e2e-b981-9c68a954c03e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:11.763720 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-5ba62d6a-2661-4e2e-b981-9c68a954c03e service neutron] 10.222.0.11 "GET /v2.0/networks?id=64a8f161-35b6-4fac-a77e-b81459bbc083 HTTP/1.1" status: 200 len: 909 time: 0.2576210 Nov 16 03:18:11.772409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-79ebcc27-1433-440b-9838-fed3bc055a66 req-3d3bf91a-9d19-478c-8c7e-b3373aeb908a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844450 Nov 16 03:18:11.796519 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ae8adf7f-1e8a-4bcc-ab42-aa3178824ea8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:11.818103 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-49b896ee-39c5-4350-89d4-f010961a22ca service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400 HTTP/1.1" status: 200 len: 217 time: 0.0444963 Nov 16 03:18:11.883566 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-977b0bee-b853-457f-925a-4e43e83c84e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:11.885227 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-977b0bee-b853-457f-925a-4e43e83c84e8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3f3c14a6-0800-4695-88cb-f795756f0d94 HTTP/1.1" status: 200 len: 848 time: 0.0581694 Nov 16 03:18:11.926323 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-44a45a4e-0344-41d6-98a7-d895bf681ce8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=64a8f161-35b6-4fac-a77e-b81459bbc083&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0291209 Nov 16 03:18:12.078934 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-076c10a3-5136-4498-9fc6-c5fea1b1d19f service neutron] 10.222.0.11 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1428785 Nov 16 03:18:12.146780 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.160037 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.217026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42838) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:12.244225 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-245bab7f-74c6-4de7-967e-5ffa6b322420 req-5994871b-7ef5-403a-9d89-32154c70eb62 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0466340 Nov 16 03:18:12.251753 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8482d592-2ab5-41fe-8818-a9cac5a1967a req-450b6a22-bd03-4868-b475-3b5c3c30db1b service neutron] 10.222.0.11 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1617987 Nov 16 03:18:12.325286 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Pushing event updated for resources: {'SecurityGroup': ['ID=863b996c-1f86-4d65-8290-cdc1eee31ce2,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:12.367035 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ae8adf7f-1e8a-4bcc-ab42-aa3178824ea8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.378312 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ae8adf7f-1e8a-4bcc-ab42-aa3178824ea8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.410562 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acca5c28-236e-4a64-b37f-150658c5d724 req-873da7f8-5b0a-4d5c-a780-befb46ac97fb tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:12.412229 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-acca5c28-236e-4a64-b37f-150658c5d724 req-873da7f8-5b0a-4d5c-a780-befb46ac97fb tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1193395 Nov 16 03:18:12.418934 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4edca234-46b0-4768-b156-33b01a2d80c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.502541 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ae8adf7f-1e8a-4bcc-ab42-aa3178824ea8 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=767a18b5f25c4f45b62a1a780f494b8e&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4589188 Nov 16 03:18:12.504112 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42842) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:12.510393 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-acca5c28-236e-4a64-b37f-150658c5d724 req-36959039-e830-47e4-8078-1fe7c14fd825 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888379 Nov 16 03:18:12.517895 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8adf7f-1e8a-4bcc-ab42-aa3178824ea8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5229ac8-bb49-4ad2-a5d7-ab5bc233266f,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:12.569132 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Allocated IP 192.168.233.155 (c8208389-f7af-46e2-99dd-85d422e4ee77/a28592e8-51b8-4f94-a27f-39d5db470e2c/a59098f4-918c-4510-9021-4bbe92f92b16) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:18:12.678107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4edca234-46b0-4768-b156-33b01a2d80c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.688614 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4edca234-46b0-4768-b156-33b01a2d80c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.690539 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0f2c2cce-d07c-4d5f-8282-0a63aa97016f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.739001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edca234-46b0-4768-b156-33b01a2d80c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad9b83ff-6530-4acb-b101-c24c30b63da8,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:12.744775 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0f2c2cce-d07c-4d5f-8282-0a63aa97016f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.794210 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4edca234-46b0-4768-b156-33b01a2d80c4 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6ef8f5c840134f2aa72460ed46753739&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5758500 Nov 16 03:18:12.800610 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 42852) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:12.836918 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeac0ffa-aaa0-4641-8c2b-eeda3c752410 req-c0b76632-a0b4-4d90-a086-2ed929b74e0b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:12.838596 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eeac0ffa-aaa0-4641-8c2b-eeda3c752410 req-c0b76632-a0b4-4d90-a086-2ed929b74e0b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 943 time: 0.1062119 Nov 16 03:18:12.912208 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2f3cc393-c51c-4127-b295-ecd555c33945 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.951853 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0f2c2cce-d07c-4d5f-8282-0a63aa97016f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.954706 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0f2c2cce-d07c-4d5f-8282-0a63aa97016f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.955978 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-0f2c2cce-d07c-4d5f-8282-0a63aa97016f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f5229ac8-bb49-4ad2-a5d7-ab5bc233266f HTTP/1.1" status: 204 len: 168 time: 0.4508979 Nov 16 03:18:12.974571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2f3cc393-c51c-4127-b295-ecd555c33945 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:12.980909 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2c2cce-d07c-4d5f-8282-0a63aa97016f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5229ac8-bb49-4ad2-a5d7-ab5bc233266f,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:12.997927 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.014774 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eeac0ffa-aaa0-4641-8c2b-eeda3c752410 req-8e053c84-c27c-4a3e-80a8-1c85c6bd130b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1504962 Nov 16 03:18:13.029849 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61d6c88-b337-4c38-91ba-59dc58b99c8c req-a1cef2e7-b3d7-449c-aa4c-424d0e2cef38 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:13.037721 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d61d6c88-b337-4c38-91ba-59dc58b99c8c req-a1cef2e7-b3d7-449c-aa4c-424d0e2cef38 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 944 time: 0.1494040 Nov 16 03:18:13.090773 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.111640 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2f3cc393-c51c-4127-b295-ecd555c33945 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.114331 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2f3cc393-c51c-4127-b295-ecd555c33945 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.118551 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-2f3cc393-c51c-4127-b295-ecd555c33945 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ad9b83ff-6530-4acb-b101-c24c30b63da8 HTTP/1.1" status: 204 len: 168 time: 0.3116610 Nov 16 03:18:13.134113 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3cc393-c51c-4127-b295-ecd555c33945 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad9b83ff-6530-4acb-b101-c24c30b63da8,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:13.178706 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Network c8208389-f7af-46e2-99dd-85d422e4ee77 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:18:13.189861 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:18:13.197327 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:18:13.233413 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d61d6c88-b337-4c38-91ba-59dc58b99c8c req-41c068ec-6445-426a-8537-8a2c11e1fefb tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1945710 Nov 16 03:18:13.269377 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Pushing event updated for resources: {'Port': ['ID=a59098f4-918c-4510-9021-4bbe92f92b16,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:13.328447 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:13.329611 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.390873 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-1e3b4935-6000-417d-99f5-73e83a04aa12 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1950417 Nov 16 03:18:13.423677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Request body: {'port': {'device_id': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:13.489679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.780800 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-1cea775a-f0c1-425d-b342-b4359dc6f003 None None] Provisioning complete for port a59098f4-918c-4510-9021-4bbe92f92b16 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:18:13.781698 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1cea775a-f0c1-425d-b342-b4359dc6f003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:13.927011 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-1cea775a-f0c1-425d-b342-b4359dc6f003 None None] Port a59098f4-918c-4510-9021-4bbe92f92b16 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:18:14.061112 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a59098f4-918c-4510-9021-4bbe92f92b16 {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:14.073916 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e5e30-c9a3-4863-98d5-63fee9d7cbd3 req-2aa9a9eb-1d12-4e9d-b27d-7faf7fc92611 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:14.076620 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.077753 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-579e5e30-c9a3-4863-98d5-63fee9d7cbd3 req-2aa9a9eb-1d12-4e9d-b27d-7faf7fc92611 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 936 time: 0.6439586 Nov 16 03:18:14.108817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Transition to ACTIVE for port object a59098f4-918c-4510-9021-4bbe92f92b16 will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:18:14.114954 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.164072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device fae71ce4-f0f2-4467-add7-7d08fa21f400 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:18:14.206698 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device da96bbab-7015-473b-bb68-ef95db66868f up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:18:14.258309 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Pushing event updated for resources: {'Port': ['ID=a59098f4-918c-4510-9021-4bbe92f92b16,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:14.366387 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575b4e80-9acb-4004-a4cb-a9feb31da4c3 req-6f9f5b1e-6c92-499e-8422-4143c09f1f7e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:14.369092 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-575b4e80-9acb-4004-a4cb-a9feb31da4c3 req-6f9f5b1e-6c92-499e-8422-4143c09f1f7e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.3330476 Nov 16 03:18:14.391931 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.db.resource_extend [None req-8a014fed-304c-467c-b873-6864f9192caa None None] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 16 03:18:14.409261 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-579e5e30-c9a3-4863-98d5-63fee9d7cbd3 req-7499eb60-4b1d-4366-9743-26e2e0d0e1d2 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2675281 Nov 16 03:18:14.530534 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-575b4e80-9acb-4004-a4cb-a9feb31da4c3 req-8ad498a2-3011-4039-ac63-90f1031b8cb8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1199291 Nov 16 03:18:14.562280 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Attempting to bind port a59098f4-918c-4510-9021-4bbe92f92b16 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:18:14.562828 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Attempting to bind port a59098f4-918c-4510-9021-4bbe92f92b16 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:18:14.563337 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Attempting to bind port a59098f4-918c-4510-9021-4bbe92f92b16 on network c8208389-f7af-46e2-99dd-85d422e4ee77 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:14.602009 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Port a59098f4-918c-4510-9021-4bbe92f92b16 on network c8208389-f7af-46e2-99dd-85d422e4ee77 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:18:14.602984 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Attempting to bind port a59098f4-918c-4510-9021-4bbe92f92b16 on network c8208389-f7af-46e2-99dd-85d422e4ee77 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:14.628643 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 18, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:18:14.629123 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Checking segment: {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:18:14.629753 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Bound using segment: {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:18:14.630475 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Bound port: a59098f4-918c-4510-9021-4bbe92f92b16, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '18372983-80c7-4077-9d6c-807fedaec4c7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 314, 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:18:14.631075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.643746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ba12af8-dcc1-4fb0-87c3-ffe516f642e7 req-4fb82432-d15b-46a3-8dec-9afde26cfd17 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:14.646757 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ba12af8-dcc1-4fb0-87c3-ffe516f642e7 req-4fb82432-d15b-46a3-8dec-9afde26cfd17 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 943 time: 0.1142392 Nov 16 03:18:14.740059 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port fae71ce4-f0f2-4467-add7-7d08fa21f400, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:14.757819 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'fae71ce4-f0f2-4467-add7-7d08fa21f400', 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083', 'port_id': 'fae71ce4-f0f2-4467-add7-7d08fa21f400', 'mac_address': 'fa:16:3e:68:9a:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3f3c14a6-0800-4695-88cb-f795756f0d94', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:18:14.838594 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ba12af8-dcc1-4fb0-87c3-ffe516f642e7 req-3f36c61c-57ba-466e-ae35-822b24c89150 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1786323 Nov 16 03:18:14.854818 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e8c2d01-b9e8-4a05-a324-f47f31a357f5 req-ef4fdd82-42f2-4c83-9647-264e3b9d6f82 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:14.858281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e8c2d01-b9e8-4a05-a324-f47f31a357f5 req-ef4fdd82-42f2-4c83-9647-264e3b9d6f82 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 944 time: 0.1790073 Nov 16 03:18:14.861559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5075b444-dbef-4286-a4bd-b3dd8a9439a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.878165 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port da96bbab-7015-473b-bb68-ef95db66868f completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:18:14.890735 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port da96bbab-7015-473b-bb68-ef95db66868f triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:18:14.891120 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.896703 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.911535 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] For port a59098f4-918c-4510-9021-4bbe92f92b16, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:18:14.935910 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] For port a59098f4-918c-4510-9021-4bbe92f92b16, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a59098f4-918c-4510-9021-4bbe92f92b16,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:18:14.948059 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:14.957109 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fae71ce4-f0f2-4467-add7-7d08fa21f400 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:15.024100 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port fae71ce4-f0f2-4467-add7-7d08fa21f400, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:15.034668 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:15.087214 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e8c2d01-b9e8-4a05-a324-f47f31a357f5 req-bf471c22-0a8d-428a-bd77-a48db370a4ec tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2098074 Nov 16 03:18:15.130799 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:15.132388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:15.134243 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] 10.222.0.11 "PUT /v2.0/ports/a59098f4-918c-4510-9021-4bbe92f92b16 HTTP/1.1" status: 200 len: 1098 time: 1.7192898 Nov 16 03:18:15.135368 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'tag': 'a59098f4-918c-4510-9021-4bbe92f92b16'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:15.140114 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=fae71ce4-f0f2-4467-add7-7d08fa21f400,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:15.152439 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:15.160777 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36441334-9c87-41c2-b806-9df0dfc9cd87" -d '{"events": [{"name": "network-changed", "server_uuid": "c9c6bc8a-d16f-4fae-96b6-7623257c73b0", "tag": "a59098f4-918c-4510-9021-4bbe92f92b16"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:15.198062 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da96bbab-7015-473b-bb68-ef95db66868f'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:15.201192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9088dbb-aaf4-45ae-a382-88933731616e" -d '{"events": [{"server_uuid": "420fb8d2-4f97-4506-838c-080e5a17d65f", "name": "network-vif-plugged", "status": "completed", "tag": "da96bbab-7015-473b-bb68-ef95db66868f"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:15.220110 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port da96bbab-7015-473b-bb68-ef95db66868f, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=da96bbab-7015-473b-bb68-ef95db66868f,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:15.229141 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:15.260168 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f716eb-10db-43c7-81c8-4a62bb1370fa service neutron] Pushing event updated for resources: {'Port': ['ID=a59098f4-918c-4510-9021-4bbe92f92b16,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:15.358637 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-300d9f07-c7c7-4331-bd71-b9382cc59365 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:15.360499 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-300d9f07-c7c7-4331-bd71-b9382cc59365 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=9dd17d33e39d4d719a978fe26d5ccb1d&device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 1101 time: 0.1229191 Nov 16 03:18:15.366053 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c21eadb-ba7d-425c-a5eb-7001a3a30592 x-openstack-request-id: req-2c21eadb-ba7d-425c-a5eb-7001a3a30592 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:15.366780 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "420fb8d2-4f97-4506-838c-080e5a17d65f", "name": "network-vif-plugged", "status": "completed", "tag": "da96bbab-7015-473b-bb68-ef95db66868f", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:15.367303 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-2c21eadb-ba7d-425c-a5eb-7001a3a30592 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:15.368150 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da96bbab-7015-473b-bb68-ef95db66868f', 'code': 200} Nov 16 03:18:15.380639 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99a26f2d-18eb-4834-8835-40c65a258f81 x-openstack-request-id: req-99a26f2d-18eb-4834-8835-40c65a258f81 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:15.381130 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9c6bc8a-d16f-4fae-96b6-7623257c73b0", "tag": "a59098f4-918c-4510-9021-4bbe92f92b16", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:15.381585 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-99a26f2d-18eb-4834-8835-40c65a258f81 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:15.382473 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'tag': 'a59098f4-918c-4510-9021-4bbe92f92b16', 'status': 'completed', 'code': 200} Nov 16 03:18:15.431777 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=da96bbab-7015-473b-bb68-ef95db66868f,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:15.532235 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['fae71ce4-f0f2-4467-add7-7d08fa21f400'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:15.588847 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-10479bf0-ce8d-42b6-b8fc-9f301ea60d83 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.155&port_id=a59098f4-918c-4510-9021-4bbe92f92b16 HTTP/1.1" status: 200 len: 217 time: 0.1646492 Nov 16 03:18:15.737955 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-8667e379-7a20-4007-bef5-fede84cab85b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:15.740169 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-8667e379-7a20-4007-bef5-fede84cab85b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a28592e8-51b8-4f94-a27f-39d5db470e2c HTTP/1.1" status: 200 len: 843 time: 0.1388319 Nov 16 03:18:15.786246 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a77f88b-82a4-44a1-acb7-ac5877a1f97a req-6a6377a4-ce0b-48b8-8b02-1ba3c9798949 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:15.795410 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2a77f88b-82a4-44a1-acb7-ac5877a1f97a req-6a6377a4-ce0b-48b8-8b02-1ba3c9798949 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 948 time: 0.1962388 Nov 16 03:18:15.894419 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-01719aa0-f4c7-4b7d-8561-02ad002877a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:15.898686 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-01719aa0-f4c7-4b7d-8561-02ad002877a2 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c8208389-f7af-46e2-99dd-85d422e4ee77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1483953 Nov 16 03:18:15.976601 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-595a4eb2-c896-408f-bd06-8063d213005f req-eac13276-175c-490c-9a63-8a10abc868e4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:15.979349 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-595a4eb2-c896-408f-bd06-8063d213005f req-eac13276-175c-490c-9a63-8a10abc868e4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.2648125 Nov 16 03:18:15.984086 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b527685-0a4f-4231-8253-37a9f6d88e81 req-4b5ab00a-9156-440c-bfa9-966120dc5d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:16.004543 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b527685-0a4f-4231-8253-37a9f6d88e81 req-4b5ab00a-9156-440c-bfa9-966120dc5d88 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 1098 time: 0.2387269 Nov 16 03:18:16.015337 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2a77f88b-82a4-44a1-acb7-ac5877a1f97a req-aaf55348-9301-449a-aedb-26fad2a803d5 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2148108 Nov 16 03:18:16.054404 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-99450cd7-62f1-4480-bfe3-cfee25d5ed3c service neutron] 10.222.0.11 "GET /v2.0/networks/c8208389-f7af-46e2-99dd-85d422e4ee77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1458435 Nov 16 03:18:16.148286 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-595a4eb2-c896-408f-bd06-8063d213005f req-69821376-962a-46f0-a7f6-10cc60a5900c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1305923 Nov 16 03:18:16.251371 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b527685-0a4f-4231-8253-37a9f6d88e81 req-14980f2f-c073-4f31-8389-c6d8cfc4eb1a service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2200201 Nov 16 03:18:16.314503 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-a8ca52d1-2aea-4f4e-a758-a02e1662920a req-d82dd107-dc7b-4f36-8882-43662eb3d75c service neutron] 10.222.0.11 "GET /v2.0/networks/c8208389-f7af-46e2-99dd-85d422e4ee77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2488074 Nov 16 03:18:16.384374 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0d1357-9ba2-467a-a0f5-c6070692aa16 req-4fa2ac28-35eb-45a0-8109-730df53e5751 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:16.399335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f0d1357-9ba2-467a-a0f5-c6070692aa16 req-4fa2ac28-35eb-45a0-8109-730df53e5751 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 944 time: 0.2207191 Nov 16 03:18:16.503921 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd10bb62-b518-4156-b657-52bafa9c6f2a req-b53cfa19-5d1a-4adc-bd2d-476ca56e91fb tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:16.514812 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cd10bb62-b518-4156-b657-52bafa9c6f2a req-b53cfa19-5d1a-4adc-bd2d-476ca56e91fb tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 945 time: 0.2204962 Nov 16 03:18:16.528402 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f0d1357-9ba2-467a-a0f5-c6070692aa16 req-51282c30-41da-423d-9777-5607f93b859b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1268518 Nov 16 03:18:16.607947 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 42992) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:16.634061 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cd10bb62-b518-4156-b657-52bafa9c6f2a req-ebf4789f-c228-4d77-9448-48c1b405a382 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143184 Nov 16 03:18:16.825641 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e7572a31-28b6-4bf8-87ab-6093b300725d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:16.972934 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:18:17.031334 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-60b7a26e-74f1-47c0-ac89-d04c714da054 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.033701 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-60b7a26e-74f1-47c0-ac89-d04c714da054 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=9dd17d33e39d4d719a978fe26d5ccb1d&device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 1101 time: 0.2018752 Nov 16 03:18:17.188698 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7341ada8-bb48-4ea4-9f8b-864624abb256 req-c18b9c2b-b21b-4ac1-8374-d6efa1c4535f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.192070 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7341ada8-bb48-4ea4-9f8b-864624abb256 req-c18b9c2b-b21b-4ac1-8374-d6efa1c4535f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 1098 time: 0.1281662 Nov 16 03:18:17.204584 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e7572a31-28b6-4bf8-87ab-6093b300725d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:17.219717 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a74164a-6f17-438b-b05d-05481688c989 req-0e7b289a-0ad2-4686-abc6-767b19dcf133 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.219881 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e7572a31-28b6-4bf8-87ab-6093b300725d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:17.228160 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a74164a-6f17-438b-b05d-05481688c989 req-0e7b289a-0ad2-4686-abc6-767b19dcf133 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 948 time: 0.0993099 Nov 16 03:18:17.333292 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-9df1488a-73cd-4e92-ace2-a21bb5209ce0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.336166 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-9df1488a-73cd-4e92-ace2-a21bb5209ce0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c8208389-f7af-46e2-99dd-85d422e4ee77 HTTP/1.1" status: 200 len: 870 time: 0.2840042 Nov 16 03:18:17.341930 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e7572a31-28b6-4bf8-87ab-6093b300725d admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cee2dd40b20344b996e66cff3e582c70&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7320199 Nov 16 03:18:17.343098 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7572a31-28b6-4bf8-87ab-6093b300725d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41e6519e-5e0a-4cda-9618-49b168046c08,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:17.346774 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43010) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:17.371539 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a74164a-6f17-438b-b05d-05481688c989 req-8397b7bd-aecd-4720-9924-b2a4603c084e tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1424003 Nov 16 03:18:17.379748 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7341ada8-bb48-4ea4-9f8b-864624abb256 req-d73c36b2-5afb-4d62-9ac1-8ad1452313bf service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1401896 Nov 16 03:18:17.398843 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e312b7b1-3ca6-48e2-8be5-6cbd46e9de68 req-f9752f6e-5a39-414e-9442-da15d09bb315 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.408143 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e312b7b1-3ca6-48e2-8be5-6cbd46e9de68 req-f9752f6e-5a39-414e-9442-da15d09bb315 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1074212 Nov 16 03:18:17.431819 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-5dd1e5cd-2da5-4bf3-b097-11008410f696 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.155&port_id=a59098f4-918c-4510-9021-4bbe92f92b16 HTTP/1.1" status: 200 len: 217 time: 0.0740833 Nov 16 03:18:17.466810 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e312b7b1-3ca6-48e2-8be5-6cbd46e9de68 req-97ba63a1-5ae2-4b50-b122-77c0e411c3c2 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572476 Nov 16 03:18:17.506103 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4aa19f0d-2e37-4375-8647-cbb57726d918 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:17.536380 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4aa19f0d-2e37-4375-8647-cbb57726d918 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:17.603265 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4aa19f0d-2e37-4375-8647-cbb57726d918 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:17.607909 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4aa19f0d-2e37-4375-8647-cbb57726d918 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:17.609593 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-4aa19f0d-2e37-4375-8647-cbb57726d918 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/41e6519e-5e0a-4cda-9618-49b168046c08 HTTP/1.1" status: 204 len: 168 time: 0.2614157 Nov 16 03:18:17.624382 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa19f0d-2e37-4375-8647-cbb57726d918 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41e6519e-5e0a-4cda-9618-49b168046c08,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:17.707057 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546097b0-6bd1-45a0-9474-48a9fe812744 req-ec3e0ad0-8ef5-4492-8329-21c57bca0a33 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.709072 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546097b0-6bd1-45a0-9474-48a9fe812744 req-ec3e0ad0-8ef5-4492-8329-21c57bca0a33 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 944 time: 0.0758281 Nov 16 03:18:17.809336 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546097b0-6bd1-45a0-9474-48a9fe812744 req-a6a66065-995b-4998-8da7-c1b68cd3946d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881736 Nov 16 03:18:17.822456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a6c155-b79f-465e-b067-c06961ff073a req-2192d1c4-d285-4cf4-b21b-1ee98dca9ee7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.830587 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-faf060fa-3300-45ff-8a33-c3778caf8758 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:17.831049 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-11a6c155-b79f-465e-b067-c06961ff073a req-2192d1c4-d285-4cf4-b21b-1ee98dca9ee7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 945 time: 0.1027348 Nov 16 03:18:17.832789 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-faf060fa-3300-45ff-8a33-c3778caf8758 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a28592e8-51b8-4f94-a27f-39d5db470e2c HTTP/1.1" status: 200 len: 843 time: 0.0842674 Nov 16 03:18:17.883464 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-11a6c155-b79f-465e-b067-c06961ff073a req-6c30f7f0-4b05-4b52-864a-7c51048b55d4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512652 Nov 16 03:18:18.004779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-a363c130-2532-4819-aef2-3650bb5ce0cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:18.006539 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-a363c130-2532-4819-aef2-3650bb5ce0cd service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c8208389-f7af-46e2-99dd-85d422e4ee77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0509868 Nov 16 03:18:18.219657 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device fae71ce4-f0f2-4467-add7-7d08fa21f400 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:18:18.221292 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-1fb9ca38-9c3b-41ff-9c60-3c54387741f4 service neutron] 10.222.0.11 "GET /v2.0/networks/c8208389-f7af-46e2-99dd-85d422e4ee77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1962874 Nov 16 03:18:18.323200 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port fae71ce4-f0f2-4467-add7-7d08fa21f400 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:18:18.331283 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 43046) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:18.343887 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port fae71ce4-f0f2-4467-add7-7d08fa21f400 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:18:18.347974 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:18.362077 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-36441334-9c87-41c2-b806-9df0dfc9cd87 req-987ec88c-55c3-47e4-af2f-640e713a04b9 service neutron] 10.222.0.11 "GET /v2.0/networks/c8208389-f7af-46e2-99dd-85d422e4ee77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1285951 Nov 16 03:18:18.473990 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a5268a57-708f-4e6c-ac06-56ec0c40d8f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:18.608101 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0dd9a058-80b9-4018-94b0-2b86e8eb11ca admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:18.641919 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:18.690993 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fae71ce4-f0f2-4467-add7-7d08fa21f400'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:18.702093 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfa4b65e-8114-4871-8c04-0c45f199a923" -d '{"events": [{"server_uuid": "46658c04-ab20-40ea-a4e6-c03fc64b2caf", "name": "network-vif-plugged", "status": "completed", "tag": "fae71ce4-f0f2-4467-add7-7d08fa21f400"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:18.719016 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port fae71ce4-f0f2-4467-add7-7d08fa21f400, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:18.727106 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:18.775872 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627efeb5-00f8-41d5-9162-5724965ff298 req-541826fa-153a-4e29-9b13-c3d3d9564ee5 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:18.784495 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-627efeb5-00f8-41d5-9162-5724965ff298 req-541826fa-153a-4e29-9b13-c3d3d9564ee5 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 948 time: 0.1899407 Nov 16 03:18:18.845262 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=fae71ce4-f0f2-4467-add7-7d08fa21f400,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:18.872442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-046c6e3b-e19b-4d5f-ad96-3a217ebe9487 req-b2719c35-e897-4b27-b2e5-2452b29d82e1 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:18.880380 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-046c6e3b-e19b-4d5f-ad96-3a217ebe9487 req-b2719c35-e897-4b27-b2e5-2452b29d82e1 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.2008908 Nov 16 03:18:18.926708 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-627efeb5-00f8-41d5-9162-5724965ff298 req-928b48b1-23c5-4629-b889-f41a52c5c7c3 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1411996 Nov 16 03:18:18.993907 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0dd9a058-80b9-4018-94b0-2b86e8eb11ca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.009689 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-046c6e3b-e19b-4d5f-ad96-3a217ebe9487 req-04f6c705-eee7-4db4-adb0-466a450c15dc tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1280379 Nov 16 03:18:19.009854 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1bbbce70-27b8-4d63-a31d-24f29215f5bd x-openstack-request-id: req-1bbbce70-27b8-4d63-a31d-24f29215f5bd {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:19.010169 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "46658c04-ab20-40ea-a4e6-c03fc64b2caf", "name": "network-vif-plugged", "status": "completed", "tag": "fae71ce4-f0f2-4467-add7-7d08fa21f400", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:19.010572 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-1bbbce70-27b8-4d63-a31d-24f29215f5bd {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:19.011310 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fae71ce4-f0f2-4467-add7-7d08fa21f400', 'code': 200} Nov 16 03:18:19.011955 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0dd9a058-80b9-4018-94b0-2b86e8eb11ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.126208 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd9a058-80b9-4018-94b0-2b86e8eb11ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b978923-7b6a-4f12-b6a5-baccc4c08050,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:19.151815 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-0dd9a058-80b9-4018-94b0-2b86e8eb11ca admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d164854003b64baab112e8939f293e9d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8191171 Nov 16 03:18:19.156815 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43092) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:19.275611 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501fa0f3-48ab-4971-837a-a65249c42984 req-388619cc-c3c8-456f-b5c7-cfdd74156a84 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:19.279543 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-501fa0f3-48ab-4971-837a-a65249c42984 req-388619cc-c3c8-456f-b5c7-cfdd74156a84 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 945 time: 0.1074245 Nov 16 03:18:19.297410 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70347ef8-2ab9-452f-81ae-feb43bde7c0e req-a769d3a9-afc0-41c9-8ff8-ed0aadcd0f5f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:19.306461 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70347ef8-2ab9-452f-81ae-feb43bde7c0e req-a769d3a9-afc0-41c9-8ff8-ed0aadcd0f5f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.1395619 Nov 16 03:18:19.323509 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c66af2f-fd97-41c4-93b6-04c9524fa19d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.356670 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c66af2f-fd97-41c4-93b6-04c9524fa19d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.421914 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-501fa0f3-48ab-4971-837a-a65249c42984 req-98bd81a5-aee4-400a-8689-7bd948384171 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116734 Nov 16 03:18:19.443510 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70347ef8-2ab9-452f-81ae-feb43bde7c0e req-63a7ac50-06a9-45a1-ae94-32767f4f91a2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359046 Nov 16 03:18:19.506852 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c66af2f-fd97-41c4-93b6-04c9524fa19d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.509719 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2c66af2f-fd97-41c4-93b6-04c9524fa19d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.510996 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2c66af2f-fd97-41c4-93b6-04c9524fa19d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/6b978923-7b6a-4f12-b6a5-baccc4c08050 HTTP/1.1" status: 204 len: 168 time: 0.3527172 Nov 16 03:18:19.546959 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c66af2f-fd97-41c4-93b6-04c9524fa19d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b978923-7b6a-4f12-b6a5-baccc4c08050,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:19.570247 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5304f7d7-2120-4985-a4b9-f7bb6bb60c97 req-3e2d18fe-bb15-4fdb-a23f-5f2143071dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:19.571618 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5304f7d7-2120-4985-a4b9-f7bb6bb60c97 req-3e2d18fe-bb15-4fdb-a23f-5f2143071dfb service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 1098 time: 0.1021593 Nov 16 03:18:19.648474 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5304f7d7-2120-4985-a4b9-f7bb6bb60c97 req-835b83d6-39b0-4c49-8965-013f59262378 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666919 Nov 16 03:18:19.742967 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:19.860436 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43116) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:20.091296 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ea7a16-d7d3-4d76-8a37-e373cb28f88d req-769cf820-163f-40a4-b545-ad4274e1e268 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:20.093941 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c2ea7a16-d7d3-4d76-8a37-e373cb28f88d req-769cf820-163f-40a4-b545-ad4274e1e268 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 948 time: 0.0919495 Nov 16 03:18:20.103650 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-50c41f77-48f8-43de-b352-c8dfc422c7ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:20.213017 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a59098f4-918c-4510-9021-4bbe92f92b16 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:18:20.236278 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c2ea7a16-d7d3-4d76-8a37-e373cb28f88d req-1264380f-b572-4e26-8cbb-03de4878a842 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1281965 Nov 16 03:18:20.325495 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-50c41f77-48f8-43de-b352-c8dfc422c7ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:20.333350 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-50c41f77-48f8-43de-b352-c8dfc422c7ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:20.504254 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-50c41f77-48f8-43de-b352-c8dfc422c7ad admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6280fb37603f4197be8d7e8abd34c05e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6414092 Nov 16 03:18:20.509476 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43154) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:20.528462 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50c41f77-48f8-43de-b352-c8dfc422c7ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d14cb2d-8884-4a4f-aa73-eea736cc5d85,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:20.626813 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-128cc430-f406-4078-9c3e-bb72d799e8c0 req-262be5b9-b6fb-4783-b448-c848d58fd5bd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:20.628960 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-128cc430-f406-4078-9c3e-bb72d799e8c0 req-262be5b9-b6fb-4783-b448-c848d58fd5bd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.2297137 Nov 16 03:18:20.639472 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a59098f4-918c-4510-9021-4bbe92f92b16, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a59098f4-918c-4510-9021-4bbe92f92b16,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:20.718196 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'a59098f4-918c-4510-9021-4bbe92f92b16', 'network_id': 'c8208389-f7af-46e2-99dd-85d422e4ee77', 'port_id': 'a59098f4-918c-4510-9021-4bbe92f92b16', 'mac_address': 'fa:16:3e:1f:6a:84', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 314, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a28592e8-51b8-4f94-a27f-39d5db470e2c', 'ip_address': '192.168.233.155'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:18:20.764865 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-faeaf48f-52f4-4cb8-84c2-1f2ef82bc942 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:20.861686 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:20.884811 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-faeaf48f-52f4-4cb8-84c2-1f2ef82bc942 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:20.893012 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-128cc430-f406-4078-9c3e-bb72d799e8c0 req-11de5093-f169-47c0-8765-05dbb732b8bc tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2469826 Nov 16 03:18:20.919529 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a59098f4-918c-4510-9021-4bbe92f92b16 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:20.920130 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 43174) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:20.976734 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1138008f-e262-4b76-8152-ddfc21330062 req-91b720e2-7a1b-4aaf-9be4-34a97b24917d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:21.006275 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1138008f-e262-4b76-8152-ddfc21330062 req-91b720e2-7a1b-4aaf-9be4-34a97b24917d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.2559807 Nov 16 03:18:21.024980 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a59098f4-918c-4510-9021-4bbe92f92b16, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a59098f4-918c-4510-9021-4bbe92f92b16,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:21.036614 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.100201 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-faeaf48f-52f4-4cb8-84c2-1f2ef82bc942 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.122333 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-faeaf48f-52f4-4cb8-84c2-1f2ef82bc942 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.128475 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-faeaf48f-52f4-4cb8-84c2-1f2ef82bc942 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/2d14cb2d-8884-4a4f-aa73-eea736cc5d85 HTTP/1.1" status: 204 len: 168 time: 0.6113932 Nov 16 03:18:21.133245 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1138008f-e262-4b76-8152-ddfc21330062 req-fef36e48-cd39-4cb9-94d4-5f63fa4568d2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1248958 Nov 16 03:18:21.163274 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faeaf48f-52f4-4cb8-84c2-1f2ef82bc942 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d14cb2d-8884-4a4f-aa73-eea736cc5d85,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:21.266892 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=a59098f4-918c-4510-9021-4bbe92f92b16,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:21.346772 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c124c133-2088-404b-80fd-f4f54aadf269 req-8f98ae01-5d98-42ed-b1eb-ce47fcea6fce tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:21.350549 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c124c133-2088-404b-80fd-f4f54aadf269 req-8f98ae01-5d98-42ed-b1eb-ce47fcea6fce tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2121878 Nov 16 03:18:21.353079 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c0bdf082-6862-4eef-b751-19330047de65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.510821 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.552645 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['a59098f4-918c-4510-9021-4bbe92f92b16'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:21.557393 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c124c133-2088-404b-80fd-f4f54aadf269 req-e20dfb9d-9cb4-4c05-a06f-ab72a11d8408 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1854360 Nov 16 03:18:21.608944 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-644befec-4716-4443-a5e7-2fb0df9f1d21 req-ae16e93c-c431-47bb-aad9-331effce8486 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:21.617905 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-644befec-4716-4443-a5e7-2fb0df9f1d21 req-ae16e93c-c431-47bb-aad9-331effce8486 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 949 time: 0.1740298 Nov 16 03:18:21.698389 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c0bdf082-6862-4eef-b751-19330047de65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.712301 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c0bdf082-6862-4eef-b751-19330047de65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.713870 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:21.803492 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-644befec-4716-4443-a5e7-2fb0df9f1d21 req-952cb826-a109-4ef4-97d0-3178d0301b8b tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1842473 Nov 16 03:18:21.869187 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43208) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:21.869874 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-c0bdf082-6862-4eef-b751-19330047de65 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ebb073769cc346efb62d473b701d755d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9411826 Nov 16 03:18:21.873993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0bdf082-6862-4eef-b751-19330047de65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7c5e1ae-f2b8-4f4d-970f-7635fc55ff6a,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:22.014086 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49144ce9-36b5-4ee1-9b2e-fdd4903aa8b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:22.041521 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49144ce9-36b5-4ee1-9b2e-fdd4903aa8b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:22.130493 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49144ce9-36b5-4ee1-9b2e-fdd4903aa8b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:22.136636 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49144ce9-36b5-4ee1-9b2e-fdd4903aa8b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:22.142043 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-49144ce9-36b5-4ee1-9b2e-fdd4903aa8b9 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/d7c5e1ae-f2b8-4f4d-970f-7635fc55ff6a HTTP/1.1" status: 204 len: 168 time: 0.2704198 Nov 16 03:18:22.173048 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49144ce9-36b5-4ee1-9b2e-fdd4903aa8b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7c5e1ae-f2b8-4f4d-970f-7635fc55ff6a,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:22.428700 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89599bfb-5d43-4d75-8f48-fd5b239057ca req-f6d78e46-ab6f-429b-9e56-3bbf356a33b0 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:22.443886 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89599bfb-5d43-4d75-8f48-fd5b239057ca req-f6d78e46-ab6f-429b-9e56-3bbf356a33b0 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.1265359 Nov 16 03:18:22.561855 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89599bfb-5d43-4d75-8f48-fd5b239057ca req-71dc0cb6-4b8f-470c-8d84-ac099210d082 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141324 Nov 16 03:18:22.879864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43258) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:22.910850 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c67e1bed-4d42-40e1-8b16-4e920e45dce3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.031986 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c67e1bed-4d42-40e1-8b16-4e920e45dce3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.039988 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c67e1bed-4d42-40e1-8b16-4e920e45dce3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.081044 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc401b2-77de-4b7f-a73d-fa2956389ad7 req-e7767af4-77fd-4491-9d5d-63a87126c686 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:23.087092 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4dc401b2-77de-4b7f-a73d-fa2956389ad7 req-e7767af4-77fd-4491-9d5d-63a87126c686 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 949 time: 0.1425316 Nov 16 03:18:23.101785 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c67e1bed-4d42-40e1-8b16-4e920e45dce3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5521cc62-1443-4ece-acbc-7d46900b89eb,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:23.111128 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c67e1bed-4d42-40e1-8b16-4e920e45dce3 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8ca2510a380c49f18a0d4cb208a3306b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2295687 Nov 16 03:18:23.117968 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43268) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:23.215434 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4dc401b2-77de-4b7f-a73d-fa2956389ad7 req-578a0c2d-d703-4ab6-af3d-98a9204a891d tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113799 Nov 16 03:18:23.239520 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5ca3cf0a-3db1-41e9-a9e9-6496afdbb5ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.303984 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5ca3cf0a-3db1-41e9-a9e9-6496afdbb5ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.419802 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5ca3cf0a-3db1-41e9-a9e9-6496afdbb5ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.424193 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5ca3cf0a-3db1-41e9-a9e9-6496afdbb5ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:23.428164 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-5ca3cf0a-3db1-41e9-a9e9-6496afdbb5ca admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/5521cc62-1443-4ece-acbc-7d46900b89eb HTTP/1.1" status: 204 len: 168 time: 0.3083465 Nov 16 03:18:23.441610 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca3cf0a-3db1-41e9-a9e9-6496afdbb5ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5521cc62-1443-4ece-acbc-7d46900b89eb,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:23.538465 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-f9f898fb-8e18-4f6c-bcd6-2b64b53f1b35 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:23.553064 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-f9f898fb-8e18-4f6c-bcd6-2b64b53f1b35 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.2442560 Nov 16 03:18:23.582440 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-38fdb2e1-de16-42a5-8a35-938d22af25a5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/quotas/61a2e084639344ff8e8d5ade2eef51d0 HTTP/1.1" status: 200 len: 375 time: 0.0271547 Nov 16 03:18:23.702772 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-9e21907d-15bc-45da-ba4a-00095583bd15 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1176620 Nov 16 03:18:23.932805 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-b62ae8fa-f13b-45bd-bfc8-8e6ac455e0a0 service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2259281 Nov 16 03:18:24.100113 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-49b23eb5-10c6-4b44-9c3f-02f5bf35abc0 service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1620872 Nov 16 03:18:24.206982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 43328) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:24.236751 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a59098f4-918c-4510-9021-4bbe92f92b16 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:18:24.247052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b1d66514-248f-4042-9577-f8a9420fe6e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.372727 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port a59098f4-918c-4510-9021-4bbe92f92b16 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:18:24.379272 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port a59098f4-918c-4510-9021-4bbe92f92b16 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:18:24.379925 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.546472 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b1d66514-248f-4042-9577-f8a9420fe6e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.559490 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b1d66514-248f-4042-9577-f8a9420fe6e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.571962 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.600631 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d66514-248f-4042-9577-f8a9420fe6e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71919868-8da7-4c7b-90c1-64621cfdb6f0,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:24.631726 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4508fca4-22d2-4ab4-8219-f5df03291d40 req-6b574421-5ef3-4c6d-aedd-48cde781e52f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:24.634858 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4508fca4-22d2-4ab4-8219-f5df03291d40 req-6b574421-5ef3-4c6d-aedd-48cde781e52f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.1437171 Nov 16 03:18:24.684957 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a59098f4-918c-4510-9021-4bbe92f92b16, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a59098f4-918c-4510-9021-4bbe92f92b16,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:24.687219 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a59098f4-918c-4510-9021-4bbe92f92b16'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:24.694076 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87b5fee9-9b0f-4239-a4d1-47de9aa23b4a" -d '{"events": [{"server_uuid": "c9c6bc8a-d16f-4fae-96b6-7623257c73b0", "name": "network-vif-plugged", "status": "completed", "tag": "a59098f4-918c-4510-9021-4bbe92f92b16"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:24.710793 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.711461 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b1d66514-248f-4042-9577-f8a9420fe6e0 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ded75241f26f4e06b681e06faff256df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5033331 Nov 16 03:18:24.714541 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43352) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:24.771857 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4508fca4-22d2-4ab4-8219-f5df03291d40 req-a1fe9fb4-ac9f-4a77-a6de-bfe4572d9cc2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996995 Nov 16 03:18:24.911881 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9b6367b3-9cda-4667-8788-0fdc8660715f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:24.929574 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58353779-a15a-4815-b827-eddac13eb71b req-bf6b38ac-93d9-4322-ada3-7942a5a124c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:24.936996 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-bf6b38ac-93d9-4322-ada3-7942a5a124c2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.1821401 Nov 16 03:18:24.942788 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=a59098f4-918c-4510-9021-4bbe92f92b16,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:25.037044 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-db338817-7134-4f02-a9f4-5f925bf7fdb6 req-8b8d3735-1751-4210-b852-5b21da90296b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 210 time: 0.1197140 Nov 16 03:18:25.147395 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd6068-0b19-4458-a9f0-c1d544f7fbcb req-883a1633-0725-484a-81d1-635c55a5605a tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:25.149335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cddd6068-0b19-4458-a9f0-c1d544f7fbcb req-883a1633-0725-484a-81d1-635c55a5605a tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.1876190 Nov 16 03:18:25.213956 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9b6367b3-9cda-4667-8788-0fdc8660715f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:25.245687 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cddd6068-0b19-4458-a9f0-c1d544f7fbcb req-d9447cd7-d9ca-4794-9744-6648233f774e tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812316 Nov 16 03:18:25.272310 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58353779-a15a-4815-b827-eddac13eb71b req-0d5b5953-d723-406f-a588-b254c5ba140a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:25.275989 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-0d5b5953-d723-406f-a588-b254c5ba140a service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.3178523 Nov 16 03:18:25.312018 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9b6367b3-9cda-4667-8788-0fdc8660715f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:25.327117 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9b6367b3-9cda-4667-8788-0fdc8660715f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:25.329001 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-9b6367b3-9cda-4667-8788-0fdc8660715f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/71919868-8da7-4c7b-90c1-64621cfdb6f0 HTTP/1.1" status: 204 len: 168 time: 0.6116562 Nov 16 03:18:25.374981 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99dfe677-ede8-4513-ad20-c9872a815884 x-openstack-request-id: req-99dfe677-ede8-4513-ad20-c9872a815884 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:25.375814 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9c6bc8a-d16f-4fae-96b6-7623257c73b0", "name": "network-vif-plugged", "status": "completed", "tag": "a59098f4-918c-4510-9021-4bbe92f92b16", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:25.375814 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-99dfe677-ede8-4513-ad20-c9872a815884 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:25.376119 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a59098f4-918c-4510-9021-4bbe92f92b16', 'code': 200} Nov 16 03:18:25.442345 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-a8e0e070-a2ef-44a8-9c2e-7d2843f71aa6 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.1565199 Nov 16 03:18:25.447897 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b6367b3-9cda-4667-8788-0fdc8660715f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71919868-8da7-4c7b-90c1-64621cfdb6f0,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:25.450004 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad8ea7d-7a4f-4456-b8c2-4802dfb69047 req-e50e9329-c773-460c-b7e0-0c92a8e57fe4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:25.475228 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dad8ea7d-7a4f-4456-b8c2-4802dfb69047 req-e50e9329-c773-460c-b7e0-0c92a8e57fe4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1715074 Nov 16 03:18:25.587762 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58353779-a15a-4815-b827-eddac13eb71b req-7445b30d-b76a-4fa1-a748-62fc6d072ccc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:25.591662 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-7445b30d-b76a-4fa1-a748-62fc6d072ccc service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.1340206 Nov 16 03:18:25.641520 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dad8ea7d-7a4f-4456-b8c2-4802dfb69047 req-abfb4559-c5b8-44b2-984a-6e6ad397a0c6 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1597035 Nov 16 03:18:25.664479 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-ce2d322f-5a25-440f-b6be-1deb94029289 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0624595 Nov 16 03:18:25.793669 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 43376) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:25.900508 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-761f6323-dbb4-423c-8cd2-565767513abf service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1890929 Nov 16 03:18:26.259364 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-554895b7-1d39-46d6-bb5e-452494ec0c80 req-532fd7aa-cd9f-401f-be64-922142e5338e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:26.262261 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-554895b7-1d39-46d6-bb5e-452494ec0c80 req-532fd7aa-cd9f-401f-be64-922142e5338e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 1103 time: 0.3613501 Nov 16 03:18:26.263560 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9712d494-ab1c-4844-bb97-24ce6bb76e4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:26.276698 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-58353779-a15a-4815-b827-eddac13eb71b req-be0aebd6-83b9-4073-8d88-87772db9cef0 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3612394 Nov 16 03:18:26.330079 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f42055bc-3ddb-4a16-a137-5fb66e4acb39 req-b4671f0f-dc30-4752-9a85-3f3ce53ed87b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 210 time: 0.0825999 Nov 16 03:18:26.420142 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3897064-010c-45a5-8dce-5a0bc76cb3da req-3213b330-e008-4a7c-86b0-1b18c05fb659 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:26.422857 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3897064-010c-45a5-8dce-5a0bc76cb3da req-3213b330-e008-4a7c-86b0-1b18c05fb659 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.3803842 Nov 16 03:18:26.627773 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-554895b7-1d39-46d6-bb5e-452494ec0c80 req-c6429b92-5e09-4766-a82f-ceb251cb63e7 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3056388 Nov 16 03:18:26.668902 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24978579-66ad-4af3-a615-f767fce77448 req-72302420-1254-4c80-a85c-124311dec54e tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:26.671973 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-24978579-66ad-4af3-a615-f767fce77448 req-72302420-1254-4c80-a85c-124311dec54e tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.3474424 Nov 16 03:18:26.703369 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3897064-010c-45a5-8dce-5a0bc76cb3da req-ea694a38-1e3e-4c45-811b-bda108a99299 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2677209 Nov 16 03:18:26.720352 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53daa05b-c27b-45de-83f0-e44fa57bf77b req-58256b9a-4903-4849-abe1-4a5ac81f2a2f tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:26.723231 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-53daa05b-c27b-45de-83f0-e44fa57bf77b req-58256b9a-4903-4849-abe1-4a5ac81f2a2f tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.2924840 Nov 16 03:18:26.803455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9712d494-ab1c-4844-bb97-24ce6bb76e4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:26.813243 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9712d494-ab1c-4844-bb97-24ce6bb76e4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:26.918418 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-53daa05b-c27b-45de-83f0-e44fa57bf77b req-6db4eb22-4df2-4ab8-ba94-352e007aed2d tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1756444 Nov 16 03:18:26.926446 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-9712d494-ab1c-4844-bb97-24ce6bb76e4f admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a387c8bc17be4d01979488ac5ec2d550&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1314406 Nov 16 03:18:26.930582 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9712d494-ab1c-4844-bb97-24ce6bb76e4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbac8fa7-1f0c-45c0-8115-75eef84ecb9d,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:26.931052 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43424) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:27.008886 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00b7a48-fd1a-419a-bee6-55c1da288ed1 req-b3906d5f-9c3e-4d5c-969a-d4ad9f4a74a2 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:27.011811 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a00b7a48-fd1a-419a-bee6-55c1da288ed1 req-b3906d5f-9c3e-4d5c-969a-d4ad9f4a74a2 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1938322 Nov 16 03:18:27.188084 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a00b7a48-fd1a-419a-bee6-55c1da288ed1 req-c5c93b05-1e92-49de-8dc8-0a2765412557 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639338 Nov 16 03:18:27.321129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5702231-2a69-4faf-9b1e-54472a770deb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:27.400057 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5702231-2a69-4faf-9b1e-54472a770deb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:27.461305 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-4d01aaf2-5488-4547-888f-080ba27bfa21 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:27.462945 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-4d01aaf2-5488-4547-888f-080ba27bfa21 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.4412441 Nov 16 03:18:27.500840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Request body: {'port': {'device_id': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'admin_state_up': True, 'tenant_id': '61a2e084639344ff8e8d5ade2eef51d0'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:27.551038 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5702231-2a69-4faf-9b1e-54472a770deb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:27.556101 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d5702231-2a69-4faf-9b1e-54472a770deb admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:27.561238 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d5702231-2a69-4faf-9b1e-54472a770deb admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/dbac8fa7-1f0c-45c0-8115-75eef84ecb9d HTTP/1.1" status: 204 len: 168 time: 0.6251254 Nov 16 03:18:27.567964 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5702231-2a69-4faf-9b1e-54472a770deb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbac8fa7-1f0c-45c0-8115-75eef84ecb9d,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:27.665529 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fa0b69c4-4c2d-4c6e-a634-d1e4cf053e52 req-49ae5cea-fed2-4cd4-bcf1-69f4f3253121 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 210 time: 0.1247914 Nov 16 03:18:27.695811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Deleting port fae71ce4-f0f2-4467-add7-7d08fa21f400 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:18:27.696338 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:27.957008 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Made reservation on behalf of 61a2e084639344ff8e8d5ade2eef51d0 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:18:27.963028 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.100964 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1672de-2bd2-4ced-b676-e989e8ca43e8 req-a2ea9d7e-bac8-410b-a2b4-1227e06bcb69 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:28.114918 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4e1672de-2bd2-4ced-b676-e989e8ca43e8 req-a2ea9d7e-bac8-410b-a2b4-1227e06bcb69 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 945 time: 0.2572093 Nov 16 03:18:28.245415 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43498) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:28.260381 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-de4270ce-377b-4286-be31-f3fdf8b1815c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.347153 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] For port fae71ce4-f0f2-4467-add7-7d08fa21f400, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fae71ce4-f0f2-4467-add7-7d08fa21f400,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:28.347751 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.362380 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-de4270ce-377b-4286-be31-f3fdf8b1815c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.368229 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-de4270ce-377b-4286-be31-f3fdf8b1815c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.419646 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Calling delete_port for fae71ce4-f0f2-4467-add7-7d08fa21f400 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:18:28.436269 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-de4270ce-377b-4286-be31-f3fdf8b1815c admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e95793d18c864cdebcdb2d17b156a000&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1888778 Nov 16 03:18:28.437536 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4270ce-377b-4286-be31-f3fdf8b1815c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74d5c296-b5dd-40e4-a818-5cc5ac69d311,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:28.440313 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43504) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:28.505263 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-62ea0820-1a72-45d5-aded-92efae054cc9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.532865 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-62ea0820-1a72-45d5-aded-92efae054cc9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.602381 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-62ea0820-1a72-45d5-aded-92efae054cc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.609656 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-62ea0820-1a72-45d5-aded-92efae054cc9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:28.611777 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-62ea0820-1a72-45d5-aded-92efae054cc9 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/74d5c296-b5dd-40e4-a818-5cc5ac69d311 HTTP/1.1" status: 204 len: 168 time: 0.1706181 Nov 16 03:18:28.630927 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62ea0820-1a72-45d5-aded-92efae054cc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74d5c296-b5dd-40e4-a818-5cc5ac69d311,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:28.954319 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4e1672de-2bd2-4ced-b676-e989e8ca43e8 req-21f4cbc9-b169-48ff-84e9-9fa195194841 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8381987 Nov 16 03:18:28.977621 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304fb38b-1363-42c2-88bf-1a7d6c6e7fe6 req-88eb4f98-004b-4c74-876b-225acf1a21da tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:28.997770 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-304fb38b-1363-42c2-88bf-1a7d6c6e7fe6 req-88eb4f98-004b-4c74-876b-225acf1a21da tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.8795717 Nov 16 03:18:29.002456 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43532) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:29.210633 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Allocated IP 172.20.0.12 (9a8436ad-09c6-4a61-8922-e3cc29d73f78/a3fb04df-83c0-4d51-afa7-1e0694c8dbc3/259ab0c6-cf7d-4e66-abd2-94758341d45b) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:18:29.295738 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-304fb38b-1363-42c2-88bf-1a7d6c6e7fe6 req-1e97c0a8-859b-48cc-8d3c-51137c1cf4f9 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2899776 Nov 16 03:18:29.322313 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8403a584-bba5-4e5a-b659-16ff8e0ee367 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.323220 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5038e9-5a51-43df-9939-39db614b502c req-8063dd6d-32fa-46bc-a5ab-6f973d07de92 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:29.324518 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b5038e9-5a51-43df-9939-39db614b502c req-8063dd6d-32fa-46bc-a5ab-6f973d07de92 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2000415 Nov 16 03:18:29.539920 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13bea649-0fad-491c-b2ee-3b8d1a74d8aa req-eb3e60b3-77df-4e35-a2a1-3c595462a21a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 210 time: 0.0639083 Nov 16 03:18:29.556724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8403a584-bba5-4e5a-b659-16ff8e0ee367 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.568591 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b5038e9-5a51-43df-9939-39db614b502c req-7254b221-2ef8-4368-a56c-f951f00e32ec tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2180219 Nov 16 03:18:29.571964 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8403a584-bba5-4e5a-b659-16ff8e0ee367 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.609685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.653957 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8403a584-bba5-4e5a-b659-16ff8e0ee367 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a9f7131cbc7543f4b947ede2f88757b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6497593 Nov 16 03:18:29.655423 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8403a584-bba5-4e5a-b659-16ff8e0ee367 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18269fd4-efeb-4303-8e3b-1d703781842d,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:29.658247 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43550) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:29.688429 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Pushing event deleted for resources: {'Port': ['ID=fae71ce4-f0f2-4467-add7-7d08fa21f400,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:29.716746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.745016 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5391166d-2c41-4bbb-9f33-de46af471801 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.760206 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] No DVR routers for this DVR port fae71ce4-f0f2-4467-add7-7d08fa21f400 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:18:29.767167 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.771553 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-24978579-66ad-4af3-a615-f767fce77448 req-c4710a33-636f-4053-bc8c-6ae788a16be1 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "DELETE /v2.0/ports/fae71ce4-f0f2-4467-add7-7d08fa21f400 HTTP/1.1" status: 204 len: 173 time: 2.7802064 Nov 16 03:18:29.772271 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'name': 'network-vif-deleted', 'tag': 'fae71ce4-f0f2-4467-add7-7d08fa21f400'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:29.772388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5391166d-2c41-4bbb-9f33-de46af471801 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.774955 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5fcf8f59-1e74-4916-ad3c-8b88a4031fa1" -d '{"events": [{"server_uuid": "46658c04-ab20-40ea-a4e6-c03fc64b2caf", "name": "network-vif-deleted", "tag": "fae71ce4-f0f2-4467-add7-7d08fa21f400"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:29.839612 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.876793 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f723042-83fb-47a8-a486-13b67b2ba044 x-openstack-request-id: req-9f723042-83fb-47a8-a486-13b67b2ba044 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:29.877340 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "46658c04-ab20-40ea-a4e6-c03fc64b2caf", "name": "network-vif-deleted", "tag": "fae71ce4-f0f2-4467-add7-7d08fa21f400", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:29.877681 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9f723042-83fb-47a8-a486-13b67b2ba044 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:29.878115 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46658c04-ab20-40ea-a4e6-c03fc64b2caf', 'name': 'network-vif-deleted', 'tag': 'fae71ce4-f0f2-4467-add7-7d08fa21f400', 'status': 'completed', 'code': 200} Nov 16 03:18:29.881044 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5391166d-2c41-4bbb-9f33-de46af471801 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.886122 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5391166d-2c41-4bbb-9f33-de46af471801 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:29.886835 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db', 'da96bbab-7015-473b-bb68-ef95db66868f'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:29.889016 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-5391166d-2c41-4bbb-9f33-de46af471801 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/18269fd4-efeb-4303-8e3b-1d703781842d HTTP/1.1" status: 204 len: 168 time: 0.2292845 Nov 16 03:18:29.900295 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5391166d-2c41-4bbb-9f33-de46af471801 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18269fd4-efeb-4303-8e3b-1d703781842d,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:29.949531 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:18:29.963185 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event updated for resources: {'Port': ['ID=259ab0c6-cf7d-4e66-abd2-94758341d45b,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:29.978404 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:18:29.981859 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:18:30.082294 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:30.082953 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:30.124499 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-d1630409-ba2c-46f9-8fb8-a32162ce7915 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6302516 Nov 16 03:18:30.156720 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Request body: {'port': {'device_id': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:30.189364 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-288ac76f-fcd7-42e4-8ca7-93bd5de4c2ee req-dd83e398-d448-46a9-94c3-1155789272d2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=46658c04-ab20-40ea-a4e6-c03fc64b2caf HTTP/1.1" status: 200 len: 210 time: 0.0520334 Nov 16 03:18:30.257545 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:30.296697 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device fae71ce4-f0f2-4467-add7-7d08fa21f400 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:18:30.422250 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: fae71ce4-f0f2-4467-add7-7d08fa21f400 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:18:30.423147 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device fae71ce4-f0f2-4467-add7-7d08fa21f400 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:18:30.632396 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43584) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:30.669666 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5f2a16a8-9eb6-40af-8462-804c330ee8fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:30.786586 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91d4888-81a5-405f-b02d-c25ad8fa7a9a req-5d62ee7b-f7d0-4afc-939b-e9baf5e29bd7 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:30.788678 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c91d4888-81a5-405f-b02d-c25ad8fa7a9a req-5d62ee7b-f7d0-4afc-939b-e9baf5e29bd7 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.2637308 Nov 16 03:18:30.875673 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5f2a16a8-9eb6-40af-8462-804c330ee8fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:30.888684 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5f2a16a8-9eb6-40af-8462-804c330ee8fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:30.900463 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab87373a-09d5-42a2-ac01-d490700b5ddc req-c13e858d-d344-49de-8893-fc2ce5809522 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:30.902830 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab87373a-09d5-42a2-ac01-d490700b5ddc req-c13e858d-d344-49de-8893-fc2ce5809522 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 932 time: 0.1659861 Nov 16 03:18:30.950430 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c91d4888-81a5-405f-b02d-c25ad8fa7a9a req-633f19e8-6e94-40df-9d18-b635f574f035 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1465776 Nov 16 03:18:31.018467 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 43592) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:31.022603 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 259ab0c6-cf7d-4e66-abd2-94758341d45b {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:31.025539 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-5f2a16a8-9eb6-40af-8462-804c330ee8fb admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c3f8747888084908b728b006e520902e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3818469 Nov 16 03:18:31.029198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2a16a8-9eb6-40af-8462-804c330ee8fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15e4f236-48af-4d24-8d77-fdc83424f26e,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:31.043182 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.116100 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab87373a-09d5-42a2-ac01-d490700b5ddc req-308c51a3-1f24-4ac2-9048-857c5783c8ff tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1880376 Nov 16 03:18:31.171935 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Transition to ACTIVE for port object 259ab0c6-cf7d-4e66-abd2-94758341d45b will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:18:31.200071 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.282972 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Pushing event updated for resources: {'Port': ['ID=259ab0c6-cf7d-4e66-abd2-94758341d45b,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:31.293745 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c422c8c-6075-4bb8-b783-378e54f0b47f req-e11d1361-e8c1-43dc-9f83-4f2b15d0e914 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:31.298519 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c422c8c-6075-4bb8-b783-378e54f0b47f req-e11d1361-e8c1-43dc-9f83-4f2b15d0e914 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1753047 Nov 16 03:18:31.298519 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31009280-b4cd-4a2b-a40a-03fb70b3205c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.411352 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31009280-b4cd-4a2b-a40a-03fb70b3205c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.507454 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Attempting to bind port 259ab0c6-cf7d-4e66-abd2-94758341d45b on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:18:31.507680 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Attempting to bind port 259ab0c6-cf7d-4e66-abd2-94758341d45b by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:18:31.508202 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Attempting to bind port 259ab0c6-cf7d-4e66-abd2-94758341d45b on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:31.534759 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c422c8c-6075-4bb8-b783-378e54f0b47f req-76f0c7c5-1c27-4534-b19d-0b8454f27716 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1959338 Nov 16 03:18:31.566923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Port 259ab0c6-cf7d-4e66-abd2-94758341d45b on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:18:31.567251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Attempting to bind port 259ab0c6-cf7d-4e66-abd2-94758341d45b on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:31.580384 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 18, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:18:31.580740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Checking segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:18:31.581131 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Bound using segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:18:31.581621 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Bound port: 259ab0c6-cf7d-4e66-abd2-94758341d45b, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:18:31.581982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.632448 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c082fda-4b4c-4954-b623-aa31667885c6 req-8422f01a-6f15-4af5-b3bc-11c732d1d43b tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:31.634427 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5c082fda-4b4c-4954-b623-aa31667885c6 req-8422f01a-6f15-4af5-b3bc-11c732d1d43b tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.1030426 Nov 16 03:18:31.680791 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31009280-b4cd-4a2b-a40a-03fb70b3205c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.684309 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-31009280-b4cd-4a2b-a40a-03fb70b3205c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.687999 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-31009280-b4cd-4a2b-a40a-03fb70b3205c admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/15e4f236-48af-4d24-8d77-fdc83424f26e HTTP/1.1" status: 204 len: 168 time: 0.6660693 Nov 16 03:18:31.725996 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31009280-b4cd-4a2b-a40a-03fb70b3205c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15e4f236-48af-4d24-8d77-fdc83424f26e,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:31.747411 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] For port 259ab0c6-cf7d-4e66-abd2-94758341d45b, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:18:31.755589 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] For port 259ab0c6-cf7d-4e66-abd2-94758341d45b, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=259ab0c6-cf7d-4e66-abd2-94758341d45b,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:18:31.769713 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.867165 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5c082fda-4b4c-4954-b623-aa31667885c6 req-61b094ab-9444-4368-8cb8-d01b4b284e8e tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2125740 Nov 16 03:18:31.876314 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:31.877615 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:31.879248 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] 10.222.0.11 "PUT /v2.0/ports/259ab0c6-cf7d-4e66-abd2-94758341d45b HTTP/1.1" status: 200 len: 1094 time: 1.7306688 Nov 16 03:18:31.879922 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'tag': '259ab0c6-cf7d-4e66-abd2-94758341d45b'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:31.882540 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a691743-fe8b-471a-93d9-9851a8c73ce7" -d '{"events": [{"name": "network-changed", "server_uuid": "5fdf0855-de57-4e84-ba51-6e27db495f65", "tag": "259ab0c6-cf7d-4e66-abd2-94758341d45b"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:31.964241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e37be921-dcbd-4d86-b16e-28583a837473 x-openstack-request-id: req-e37be921-dcbd-4d86-b16e-28583a837473 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:31.964531 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5fdf0855-de57-4e84-ba51-6e27db495f65", "tag": "259ab0c6-cf7d-4e66-abd2-94758341d45b", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:31.964773 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-e37be921-dcbd-4d86-b16e-28583a837473 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:31.965356 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'tag': '259ab0c6-cf7d-4e66-abd2-94758341d45b', 'status': 'completed', 'code': 200} Nov 16 03:18:31.977731 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06e9d1a2-250a-4c8c-98e9-4d5679b29cdd service neutron] Pushing event updated for resources: {'Port': ['ID=259ab0c6-cf7d-4e66-abd2-94758341d45b,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:32.045211 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-6b5c440c-918a-4401-949e-78a2e51c8f5b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:32.046926 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-6b5c440c-918a-4401-949e-78a2e51c8f5b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/networks?id=64a8f161-35b6-4fac-a77e-b81459bbc083 HTTP/1.1" status: 200 len: 808 time: 0.2288816 Nov 16 03:18:32.078092 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-3a956e7e-44e0-477e-a473-b5c4458f7c05 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/quotas/7abc18a290264877b7cce57e27056ccf HTTP/1.1" status: 200 len: 375 time: 0.0186622 Nov 16 03:18:32.126323 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-6df953cc-d2f6-4987-a69d-561f883b4472 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=7abc18a290264877b7cce57e27056ccf&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0413520 Nov 16 03:18:32.324164 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-e3690152-9e2c-46f5-ae81-70c93e8d0461 service neutron] 10.222.0.31 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1922002 Nov 16 03:18:32.346607 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae2ea681-420a-4c3b-8e3b-2c943bb2d50b req-0b4db6e6-9813-4dfd-a7ba-1b24ce4d5449 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:32.348437 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ae2ea681-420a-4c3b-8e3b-2c943bb2d50b req-0b4db6e6-9813-4dfd-a7ba-1b24ce4d5449 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.0818322 Nov 16 03:18:32.470519 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ae2ea681-420a-4c3b-8e3b-2c943bb2d50b req-9fc0036d-6b51-46b4-8705-5a0ad96178a1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116836 Nov 16 03:18:32.491273 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-ee04b5b2-023f-459d-ac4c-8609a4e9829e service neutron] 10.222.0.31 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1417904 Nov 16 03:18:32.711644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32cd7f5c-5e92-419a-89ae-ea9d8b1f9149 req-a1a20530-f4f2-4f65-a544-a132e96564af tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:32.713641 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-32cd7f5c-5e92-419a-89ae-ea9d8b1f9149 req-a1a20530-f4f2-4f65-a544-a132e96564af tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1115923 Nov 16 03:18:32.736109 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-77b234fc-8ec0-4ed1-8f5d-32e404e911c6 req-6def5281-1043-4dd0-b9cc-b1db862b686d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 210 time: 0.0504754 Nov 16 03:18:32.817645 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43674) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:32.825862 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-32cd7f5c-5e92-419a-89ae-ea9d8b1f9149 req-e859bee5-613d-413a-b37e-ef32e11da879 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0849543 Nov 16 03:18:32.972599 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-69e9adb2-d9aa-43a6-9912-5996ff1929a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.095724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-69e9adb2-d9aa-43a6-9912-5996ff1929a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.099296 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34697f53-9dcb-4ed2-8ab7-76bff3890040 req-2dbd376f-7cf5-487c-b5eb-9cc163432cdc tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:33.102956 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-34697f53-9dcb-4ed2-8ab7-76bff3890040 req-2dbd376f-7cf5-487c-b5eb-9cc163432cdc tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.1127863 Nov 16 03:18:33.105723 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-69e9adb2-d9aa-43a6-9912-5996ff1929a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.185880 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-69e9adb2-d9aa-43a6-9912-5996ff1929a1 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=66ac9d6bd78b4cf0b360cab7b5d9ec44&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3668244 Nov 16 03:18:33.187302 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e9adb2-d9aa-43a6-9912-5996ff1929a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56622e61-8e11-41a8-8227-1de8d173f0e4,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:33.193513 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43684) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:33.204550 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-34697f53-9dcb-4ed2-8ab7-76bff3890040 req-7567c9ba-16e5-4bf0-a234-93969f94b691 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911536 Nov 16 03:18:33.278431 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca35d627-28a3-4f85-817c-de64ed663aba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.314882 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca35d627-28a3-4f85-817c-de64ed663aba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.372097 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca35d627-28a3-4f85-817c-de64ed663aba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.375081 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca35d627-28a3-4f85-817c-de64ed663aba admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.376424 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ca35d627-28a3-4f85-817c-de64ed663aba admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/56622e61-8e11-41a8-8227-1de8d173f0e4 HTTP/1.1" status: 204 len: 168 time: 0.1810567 Nov 16 03:18:33.390299 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca35d627-28a3-4f85-817c-de64ed663aba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56622e61-8e11-41a8-8227-1de8d173f0e4,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:33.654506 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba94bd5-748c-41df-9ae1-c93a0f339555 req-7c743b87-fc48-4718-9f94-49a3db380b89 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:33.657450 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eba94bd5-748c-41df-9ae1-c93a0f339555 req-7c743b87-fc48-4718-9f94-49a3db380b89 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.0739772 Nov 16 03:18:33.734374 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eba94bd5-748c-41df-9ae1-c93a0f339555 req-6dc5592d-63ac-46ab-bca5-fdde07b09bdd tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641556 Nov 16 03:18:33.771396 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 43696) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:33.791330 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3f680dd8-9420-4307-8d9a-916c7062dc3b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.913143 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-56b5f91a-be20-4b66-9166-dec808c237c2 req-a5b4cca3-0646-4d8f-bffe-91f87cb7f38b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 210 time: 0.0519805 Nov 16 03:18:33.977494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3f680dd8-9420-4307-8d9a-916c7062dc3b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:33.994080 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3f680dd8-9420-4307-8d9a-916c7062dc3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:34.057849 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f680dd8-9420-4307-8d9a-916c7062dc3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c76e856-414a-42f6-8133-6472ae3eb3bf,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:34.066160 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-3f680dd8-9420-4307-8d9a-916c7062dc3b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=45dedc1cc9ac42fc8bfaa94328e4803e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2933900 Nov 16 03:18:34.069724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 43702) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:34.094073 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418f806f-29f2-4896-abcc-8ede95084333 req-2fa929ef-0449-40c1-b144-0fd9244714b7 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:34.097300 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-418f806f-29f2-4896-abcc-8ede95084333 req-2fa929ef-0449-40c1-b144-0fd9244714b7 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1391909 Nov 16 03:18:34.128523 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a21baff8-06e1-4f5a-ad2f-d6800166f03e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:34.157866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a21baff8-06e1-4f5a-ad2f-d6800166f03e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:34.163141 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-418f806f-29f2-4896-abcc-8ede95084333 req-b7928aae-9e07-4871-ba33-cf12fb5f2d2e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595713 Nov 16 03:18:34.225127 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a21baff8-06e1-4f5a-ad2f-d6800166f03e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:34.227764 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a21baff8-06e1-4f5a-ad2f-d6800166f03e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:34.228948 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-a21baff8-06e1-4f5a-ad2f-d6800166f03e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9c76e856-414a-42f6-8133-6472ae3eb3bf HTTP/1.1" status: 204 len: 168 time: 0.1583486 Nov 16 03:18:34.237544 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21baff8-06e1-4f5a-ad2f-d6800166f03e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c76e856-414a-42f6-8133-6472ae3eb3bf,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:34.411590 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54eda8c3-aa0d-49d5-b88a-f943c7b28030 req-e359182e-7d0a-4027-96a1-80276d667bb6 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:34.414303 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54eda8c3-aa0d-49d5-b88a-f943c7b28030 req-e359182e-7d0a-4027-96a1-80276d667bb6 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.0905604 Nov 16 03:18:34.489785 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54eda8c3-aa0d-49d5-b88a-f943c7b28030 req-ecdb1155-4a06-4087-9f30-676ce9cb6bdf tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683260 Nov 16 03:18:34.897975 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a87b1c9-e8fb-46fb-92a7-47d4adeb826b req-c0ab4470-d685-45ba-b3c3-0fa1a49d0b56 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:34.899489 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a87b1c9-e8fb-46fb-92a7-47d4adeb826b req-c0ab4470-d685-45ba-b3c3-0fa1a49d0b56 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.0694065 Nov 16 03:18:34.997024 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a87b1c9-e8fb-46fb-92a7-47d4adeb826b req-5894a871-a6f2-46e9-9aaa-ece4b50826cf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883451 Nov 16 03:18:35.005368 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a691743-fe8b-471a-93d9-9851a8c73ce7 req-f7aad406-4d73-404a-ab06-acb52d56a688 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:35.007913 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1a691743-fe8b-471a-93d9-9851a8c73ce7 req-f7aad406-4d73-404a-ab06-acb52d56a688 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 1097 time: 0.1074336 Nov 16 03:18:35.045054 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-51acc3e5-354f-4f42-8c29-73e06b203ec2 req-f4a1c324-b402-4339-8c14-4e1647739e14 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 210 time: 0.0311382 Nov 16 03:18:35.249141 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a691743-fe8b-471a-93d9-9851a8c73ce7 req-c243e7d2-95ad-45c7-911e-e081580a1b77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:35.251526 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1a691743-fe8b-471a-93d9-9851a8c73ce7 req-c243e7d2-95ad-45c7-911e-e081580a1b77 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1660280 Nov 16 03:18:35.405513 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e8631d-e681-42aa-a407-24611e17e092 req-831fbc71-dae5-4771-8f6d-df0ed216a255 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:35.407180 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-48e8631d-e681-42aa-a407-24611e17e092 req-831fbc71-dae5-4771-8f6d-df0ed216a255 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1476030 Nov 16 03:18:35.447100 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a691743-fe8b-471a-93d9-9851a8c73ce7 req-af36d159-105b-4c01-8576-435290c2ee27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:35.449626 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1a691743-fe8b-471a-93d9-9851a8c73ce7 req-af36d159-105b-4c01-8576-435290c2ee27 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1741652 Nov 16 03:18:35.505281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-48e8631d-e681-42aa-a407-24611e17e092 req-da286389-7a46-4714-89e5-a2efb016b6f1 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716281 Nov 16 03:18:35.680433 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-0442ab13-cf1d-4bcd-adc8-b1a1e3f2f657 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:35.682206 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-0442ab13-cf1d-4bcd-adc8-b1a1e3f2f657 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 1097 time: 0.1200707 Nov 16 03:18:35.697391 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f21fa3d-ede0-4b6a-8e56-8d65e435c3ae req-72c3bb79-cf8c-463a-94bc-3132fe0547ea tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:35.699256 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f21fa3d-ede0-4b6a-8e56-8d65e435c3ae req-72c3bb79-cf8c-463a-94bc-3132fe0547ea tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.1021352 Nov 16 03:18:35.761873 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-b40f5d01-6c24-47c6-bd09-32c6780f4e30 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=259ab0c6-cf7d-4e66-abd2-94758341d45b HTTP/1.1" status: 200 len: 217 time: 0.0520263 Nov 16 03:18:35.789417 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:36.186207 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f21fa3d-ede0-4b6a-8e56-8d65e435c3ae req-c01b27c6-cdfc-4495-9e89-076d9ca4a5c6 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4643159 Nov 16 03:18:36.194121 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06355d2a-c184-4882-8987-945564aa9567 req-8ac6ee80-e60b-4a0f-85f0-744a99a9b38b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:36.197268 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-8ac6ee80-e60b-4a0f-85f0-744a99a9b38b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.4257417 Nov 16 03:18:36.255944 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-0dca8042-5c6a-47ec-904f-86e7abded691 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406747 Nov 16 03:18:36.364601 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-10f03591-358c-4f28-b596-c4553b4d1cf0 req-172631ae-314a-4f18-8e3e-bc7f1a55ade2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 210 time: 0.0786576 Nov 16 03:18:36.371543 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-9231d2ba-a7c1-4b38-a736-aac7a820c89e tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:36.373058 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-9231d2ba-a7c1-4b38-a736-aac7a820c89e tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "GET /v2.0/networks?id=64a8f161-35b6-4fac-a77e-b81459bbc083 HTTP/1.1" status: 200 len: 808 time: 0.5319021 Nov 16 03:18:36.387472 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6e49bf-a6e2-4f66-9212-28aebcec5fc1 req-2f17875b-4e3e-46a8-8a3e-128e2350a6bf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:36.389040 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d6e49bf-a6e2-4f66-9212-28aebcec5fc1 req-2f17875b-4e3e-46a8-8a3e-128e2350a6bf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.2233331 Nov 16 03:18:36.467902 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-38c8e28a-e5e8-484a-bad2-687cb504e639 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1952994 Nov 16 03:18:36.476831 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d6e49bf-a6e2-4f66-9212-28aebcec5fc1 req-c19dd1c0-b3d4-4d04-8dc6-89bebcec8166 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0793154 Nov 16 03:18:36.497348 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Request body: {'port': {'device_id': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083', 'admin_state_up': True, 'tenant_id': '7abc18a290264877b7cce57e27056ccf'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:36.792501 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-06355d2a-c184-4882-8987-945564aa9567 req-22308598-73a9-4264-8b5f-751a13feef80 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3019760 Nov 16 03:18:36.802524 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-889f7e82-23b4-414a-af58-608f005cfa7c req-0ed5f30b-329a-4d2a-9c6f-4ba0206f46c3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:36.804249 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-889f7e82-23b4-414a-af58-608f005cfa7c req-0ed5f30b-329a-4d2a-9c6f-4ba0206f46c3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1621222 Nov 16 03:18:36.832323 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Made reservation on behalf of 7abc18a290264877b7cce57e27056ccf for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:18:36.836222 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:36.906683 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-889f7e82-23b4-414a-af58-608f005cfa7c req-c75c4303-eb32-44a2-b60c-614d2633d0c9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835094 Nov 16 03:18:36.929701 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-913899fe-7055-4e2f-8814-f4bba091bb82 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:36.934553 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-913899fe-7055-4e2f-8814-f4bba091bb82 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.11 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.1918771 Nov 16 03:18:37.101177 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Allocated IP 172.20.0.4 (64a8f161-35b6-4fac-a77e-b81459bbc083/3f3c14a6-0800-4695-88cb-f795756f0d94/3d8fe632-f146-4e90-a336-fff78b854aa3) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:18:37.163690 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Deleting port a59098f4-918c-4510-9021-4bbe92f92b16 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:18:37.164123 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.343339 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] For port a59098f4-918c-4510-9021-4bbe92f92b16, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a59098f4-918c-4510-9021-4bbe92f92b16,segment=NetworkSegment(18372983-80c7-4077-9d6c-807fedaec4c7),segment_id=18372983-80c7-4077-9d6c-807fedaec4c7)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:37.344048 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.366396 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Calling delete_port for a59098f4-918c-4510-9021-4bbe92f92b16 owned by compute:nova {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:18:37.424702 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.454406 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afdf02df-b6f1-498c-a35b-a901472ee4d2 req-9c7387e6-02b0-4075-b6c1-44e573c19c58 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:37.456109 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-afdf02df-b6f1-498c-a35b-a901472ee4d2 req-9c7387e6-02b0-4075-b6c1-44e573c19c58 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 950 time: 0.0975149 Nov 16 03:18:37.523555 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d9d0b572-84c6-443e-8d46-f24146edd136 req-504026d2-17a8-4f67-b8ec-207f0e8945ee tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 210 time: 0.0598388 Nov 16 03:18:37.554215 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.602047 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-afdf02df-b6f1-498c-a35b-a901472ee4d2 req-603b7f1c-e135-4fa6-8ae3-9413a9c4d5cb tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/security-groups?id=863b996c-1f86-4d65-8290-cdc1eee31ce2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1296871 Nov 16 03:18:37.617510 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Network 64a8f161-35b6-4fac-a77e-b81459bbc083 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:18:37.621403 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:18:37.626080 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:18:37.633676 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Pushing event updated for resources: {'Port': ['ID=3d8fe632-f146-4e90-a336-fff78b854aa3,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:37.691093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:37.691764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.715441 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.740286 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a3160372-c8fd-4808-8383-49bd6b06a100 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2519763 Nov 16 03:18:37.756555 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Pushing event deleted for resources: {'Port': ['ID=a59098f4-918c-4510-9021-4bbe92f92b16,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:37.774347 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['a59098f4-918c-4510-9021-4bbe92f92b16'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:37.779216 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4d48f9-1b45-441a-afc6-6f8167ed4d82 req-8289209f-2d68-492c-817a-f1bdd7b7260b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:37.794335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5d4d48f9-1b45-441a-afc6-6f8167ed4d82 req-8289209f-2d68-492c-817a-f1bdd7b7260b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.1102631 Nov 16 03:18:37.831492 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Request body: {'port': {'device_id': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:18:37.871088 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] No DVR routers for this DVR port a59098f4-918c-4510-9021-4bbe92f92b16 on host hv-cinder-81803 {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:18:37.875912 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:37.880501 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-560bcd29-7186-4f28-8038-4611089aa0e9 req-3b34eab0-5528-40b4-9ba5-bedf83eee608 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.11 "DELETE /v2.0/ports/a59098f4-918c-4510-9021-4bbe92f92b16 HTTP/1.1" status: 204 len: 173 time: 0.9372051 Nov 16 03:18:37.880991 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'name': 'network-vif-deleted', 'tag': 'a59098f4-918c-4510-9021-4bbe92f92b16'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:37.884641 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f6e66f9-3bf3-4ff3-9a5a-543c3ad1f9b2" -d '{"events": [{"server_uuid": "c9c6bc8a-d16f-4fae-96b6-7623257c73b0", "name": "network-vif-deleted", "tag": "a59098f4-918c-4510-9021-4bbe92f92b16"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:37.938437 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-052a7e20-5044-4f4e-bdbc-4e42774c1d17 x-openstack-request-id: req-052a7e20-5044-4f4e-bdbc-4e42774c1d17 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:37.939176 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9c6bc8a-d16f-4fae-96b6-7623257c73b0", "name": "network-vif-deleted", "tag": "a59098f4-918c-4510-9021-4bbe92f92b16", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:37.939257 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-052a7e20-5044-4f4e-bdbc-4e42774c1d17 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:37.939843 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9c6bc8a-d16f-4fae-96b6-7623257c73b0', 'name': 'network-vif-deleted', 'tag': 'a59098f4-918c-4510-9021-4bbe92f92b16', 'status': 'completed', 'code': 200} Nov 16 03:18:37.963742 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5d4d48f9-1b45-441a-afc6-6f8167ed4d82 req-8cf6df6e-c46c-498d-aaaf-eb39d18c839c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1680195 Nov 16 03:18:37.983072 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:38.187710 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ae3051-35e6-4e9d-b72e-91b21b595319 req-1a23c62c-6065-4d9b-ad5f-bb7b5390c8c8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:38.189455 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3ae3051-35e6-4e9d-b72e-91b21b595319 req-1a23c62c-6065-4d9b-ad5f-bb7b5390c8c8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1444988 Nov 16 03:18:38.310075 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3ae3051-35e6-4e9d-b72e-91b21b595319 req-e22b3f66-1d69-4710-a92b-32bd28b959f8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1119347 Nov 16 03:18:38.413186 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3d8fe632-f146-4e90-a336-fff78b854aa3 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:38.423036 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:38.442192 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Transition to ACTIVE for port object 3d8fe632-f146-4e90-a336-fff78b854aa3 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:18:38.449161 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:38.517627 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Pushing event updated for resources: {'Port': ['ID=3d8fe632-f146-4e90-a336-fff78b854aa3,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:38.602185 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Attempting to bind port 3d8fe632-f146-4e90-a336-fff78b854aa3 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:18:38.602631 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Attempting to bind port 3d8fe632-f146-4e90-a336-fff78b854aa3 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:18:38.602891 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Attempting to bind port 3d8fe632-f146-4e90-a336-fff78b854aa3 on network 64a8f161-35b6-4fac-a77e-b81459bbc083 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:38.608578 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Port 3d8fe632-f146-4e90-a336-fff78b854aa3 on network 64a8f161-35b6-4fac-a77e-b81459bbc083 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:18:38.608904 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Attempting to bind port 3d8fe632-f146-4e90-a336-fff78b854aa3 on network 64a8f161-35b6-4fac-a77e-b81459bbc083 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:18:38.614830 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 18, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:18:38.615151 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Checking segment: {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:18:38.615537 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Bound using segment: {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:18:38.615970 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Bound port: 3d8fe632-f146-4e90-a336-fff78b854aa3, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f570f171-eae9-4b0b-8ea1-0350983b2fe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:18:38.616327 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:38.724224 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] For port 3d8fe632-f146-4e90-a336-fff78b854aa3, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:18:38.764333 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b32960f8-9060-4fed-9ed7-0579cc4474e8 req-b136b8b5-f05a-4bc3-8ac4-6a0645096aa9 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0455649 Nov 16 03:18:38.766295 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] For port 3d8fe632-f146-4e90-a336-fff78b854aa3, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=3d8fe632-f146-4e90-a336-fff78b854aa3,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:18:38.775511 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1081c6f-8291-49cf-96fe-169043c03369 req-7dc0ce3a-b641-4b77-a0bb-6da444016221 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:38.777352 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c1081c6f-8291-49cf-96fe-169043c03369 req-7dc0ce3a-b641-4b77-a0bb-6da444016221 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.1223254 Nov 16 03:18:38.779104 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:38.834394 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:38.835014 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:38.836426 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] 10.222.0.11 "PUT /v2.0/ports/3d8fe632-f146-4e90-a336-fff78b854aa3 HTTP/1.1" status: 200 len: 1093 time: 1.0388269 Nov 16 03:18:38.838807 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'tag': '3d8fe632-f146-4e90-a336-fff78b854aa3'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:38.841164 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc29b368-fa76-42a4-86fa-0ef76ccb2998" -d '{"events": [{"name": "network-changed", "server_uuid": "e2586444-2ca8-418e-aadc-59a07a8ae2ae", "tag": "3d8fe632-f146-4e90-a336-fff78b854aa3"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:38.873854 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59e25ce-448c-4ad5-985c-b37b8a82ba0c service neutron] Pushing event updated for resources: {'Port': ['ID=3d8fe632-f146-4e90-a336-fff78b854aa3,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:38.885580 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a377470-986a-4db1-b266-906a9d123e27 x-openstack-request-id: req-4a377470-986a-4db1-b266-906a9d123e27 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:38.885685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e2586444-2ca8-418e-aadc-59a07a8ae2ae", "tag": "3d8fe632-f146-4e90-a336-fff78b854aa3", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:38.885932 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-4a377470-986a-4db1-b266-906a9d123e27 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:38.886346 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'tag': '3d8fe632-f146-4e90-a336-fff78b854aa3', 'status': 'completed', 'code': 200} Nov 16 03:18:38.891526 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c1081c6f-8291-49cf-96fe-169043c03369 req-dd588548-bf0f-4974-99d9-6629182667bd tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851858 Nov 16 03:18:39.129093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcef26f7-077a-47c0-b0b8-158bdc9a0889 req-73571bb2-ac9f-4709-a322-3339cfe5ee82 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:39.130653 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fcef26f7-077a-47c0-b0b8-158bdc9a0889 req-73571bb2-ac9f-4709-a322-3339cfe5ee82 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.0610938 Nov 16 03:18:39.197572 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fcef26f7-077a-47c0-b0b8-158bdc9a0889 req-87d6708d-13cb-442a-82b6-27473194eb11 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593967 Nov 16 03:18:39.444314 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1792272-94b4-47cf-8fc2-39634f5511c3 req-206077bb-47b7-410d-9c58-f74ed42b7e54 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:39.445976 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b1792272-94b4-47cf-8fc2-39634f5511c3 req-206077bb-47b7-410d-9c58-f74ed42b7e54 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0541835 Nov 16 03:18:39.511196 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b1792272-94b4-47cf-8fc2-39634f5511c3 req-2a79dc5d-f220-4682-82b9-2227ed213cbd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579369 Nov 16 03:18:39.892600 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6897c693-2c88-4c1e-a477-df639596b53d req-1aeb0aef-63b8-4d58-bd55-0432ab6537bb tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0288126 Nov 16 03:18:40.042462 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d866f18-9f31-4c05-a498-42152971b91c req-12d990ae-a8ae-42cb-80aa-4749143b8556 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:40.046540 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d866f18-9f31-4c05-a498-42152971b91c req-12d990ae-a8ae-42cb-80aa-4749143b8556 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.0694714 Nov 16 03:18:40.107975 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d866f18-9f31-4c05-a498-42152971b91c req-64774553-88a7-44df-befd-e1ac2e3cfd5d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550404 Nov 16 03:18:40.348393 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a987a44b-2864-40a4-a1ee-717375390924 req-8f7112d2-9239-4325-9eaf-e559a39f1036 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:40.350024 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a987a44b-2864-40a4-a1ee-717375390924 req-8f7112d2-9239-4325-9eaf-e559a39f1036 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.0527973 Nov 16 03:18:40.404967 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a987a44b-2864-40a4-a1ee-717375390924 req-4301b5e0-f806-4b60-871e-602344dc7c8c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486088 Nov 16 03:18:40.636665 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c1be69-6eb9-4d3b-8b9a-018b9cd833a2 req-0cfa57a7-810e-439f-ae0a-1c22f09f4e8a tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:40.638896 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7c1be69-6eb9-4d3b-8b9a-018b9cd833a2 req-0cfa57a7-810e-439f-ae0a-1c22f09f4e8a tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0524025 Nov 16 03:18:40.700174 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7c1be69-6eb9-4d3b-8b9a-018b9cd833a2 req-3777d240-5d8e-47b0-8ea1-9a70c02ca2fe tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538688 Nov 16 03:18:41.016121 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5a0cf6b0-473c-4cef-8823-512cf3b6a5d5 req-14c315fd-4391-4ed6-8b3b-e52671726cf8 tempest-VolumesNegativeTest-1914971341 tempest-VolumesNegativeTest-1914971341-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9c6bc8a-d16f-4fae-96b6-7623257c73b0 HTTP/1.1" status: 200 len: 210 time: 0.0354826 Nov 16 03:18:41.024481 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a59098f4-918c-4510-9021-4bbe92f92b16 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:18:41.047930 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: a59098f4-918c-4510-9021-4bbe92f92b16 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:18:41.048246 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a59098f4-918c-4510-9021-4bbe92f92b16 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:18:41.117170 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc29b368-fa76-42a4-86fa-0ef76ccb2998 req-504a3559-f976-4458-81b6-39e42a7f0d80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.118760 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fc29b368-fa76-42a4-86fa-0ef76ccb2998 req-504a3559-f976-4458-81b6-39e42a7f0d80 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7abc18a290264877b7cce57e27056ccf&device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 1096 time: 0.0461125 Nov 16 03:18:41.290354 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f38ae5-94bf-4337-9023-f14f61bc6cb5 req-a277acdb-64a9-4083-b6f8-3bc6b4287450 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.292119 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-77f38ae5-94bf-4337-9023-f14f61bc6cb5 req-a277acdb-64a9-4083-b6f8-3bc6b4287450 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.0895407 Nov 16 03:18:41.298409 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc29b368-fa76-42a4-86fa-0ef76ccb2998 req-2042c8ce-e7c5-4076-a282-d02252582cd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.300281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fc29b368-fa76-42a4-86fa-0ef76ccb2998 req-2042c8ce-e7c5-4076-a282-d02252582cd8 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=7abc18a290264877b7cce57e27056ccf&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1600828 Nov 16 03:18:41.416982 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-77f38ae5-94bf-4337-9023-f14f61bc6cb5 req-35e6261c-03c4-4a9b-a9f6-342dfdb6e43b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128066 Nov 16 03:18:41.463282 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc29b368-fa76-42a4-86fa-0ef76ccb2998 req-bee554ac-db68-4a57-8fba-7c594fb284e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.465970 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fc29b368-fa76-42a4-86fa-0ef76ccb2998 req-bee554ac-db68-4a57-8fba-7c594fb284e8 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1544111 Nov 16 03:18:41.618291 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f6c8f2-ff26-4861-95a7-544fd9ee7f5e req-9102cbb9-3a2f-4d4b-a01c-bec7a59fb821 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.619860 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-76f6c8f2-ff26-4861-95a7-544fd9ee7f5e req-9102cbb9-3a2f-4d4b-a01c-bec7a59fb821 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 944 time: 0.0897596 Nov 16 03:18:41.623476 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a26ad9bc-b611-46f9-aa5f-6574c62f6860 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.625099 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-a26ad9bc-b611-46f9-aa5f-6574c62f6860 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7abc18a290264877b7cce57e27056ccf&device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 1096 time: 0.0631399 Nov 16 03:18:41.742288 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-0e862f51-03fd-426e-8361-70095a8f8f38 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d8fe632-f146-4e90-a336-fff78b854aa3 HTTP/1.1" status: 200 len: 217 time: 0.0923479 Nov 16 03:18:41.821665 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-76f6c8f2-ff26-4861-95a7-544fd9ee7f5e req-82e11750-e743-441a-aa21-5a13345c82f4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1909075 Nov 16 03:18:41.850787 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-87819d72-f452-486c-93fb-667e76287c93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:41.852434 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-87819d72-f452-486c-93fb-667e76287c93 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3f3c14a6-0800-4695-88cb-f795756f0d94 HTTP/1.1" status: 200 len: 848 time: 0.0998921 Nov 16 03:18:41.958485 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-fef4fbd8-1caa-46b9-85ad-87f6eaa8f18a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=64a8f161-35b6-4fac-a77e-b81459bbc083&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0847709 Nov 16 03:18:42.007540 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 259ab0c6-cf7d-4e66-abd2-94758341d45b details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:18:42.040761 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a518bfe-468f-4709-ac77-19f7ed6423a8 req-9fdbfe13-3d8b-4038-b727-4005cf896b39 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:42.043073 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3a518bfe-468f-4709-ac77-19f7ed6423a8 req-9fdbfe13-3d8b-4038-b727-4005cf896b39 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1937089 Nov 16 03:18:42.133878 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3a518bfe-468f-4709-ac77-19f7ed6423a8 req-433cb740-3345-4e72-a32e-58d58cd8742b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840530 Nov 16 03:18:42.136522 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-90726ca6-fe7e-4f4f-9565-5263db323a24 service neutron] 10.222.0.11 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1621258 Nov 16 03:18:42.154841 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 259ab0c6-cf7d-4e66-abd2-94758341d45b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=259ab0c6-cf7d-4e66-abd2-94758341d45b,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:42.168739 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '259ab0c6-cf7d-4e66-abd2-94758341d45b', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'port_id': '259ab0c6-cf7d-4e66-abd2-94758341d45b', 'mac_address': 'fa:16:3e:36:c2:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 327, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3fb04df-83c0-4d51-afa7-1e0694c8dbc3', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:18:42.213577 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:42.231601 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 259ab0c6-cf7d-4e66-abd2-94758341d45b {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:42.258232 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 259ab0c6-cf7d-4e66-abd2-94758341d45b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=259ab0c6-cf7d-4e66-abd2-94758341d45b,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:42.265383 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:42.269382 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea6a7be-3989-48a4-8802-913aa75417b0 req-f67eff5c-fdda-478a-9be8-4dda8294b76b service neutron] 10.222.0.11 "GET /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247206 Nov 16 03:18:42.341897 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=259ab0c6-cf7d-4e66-abd2-94758341d45b,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:42.596825 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a239d806-dc9a-41f1-bc4f-1d376308effc req-2f574946-7a34-4677-a9d0-2a69f3b2a31c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:42.598555 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a239d806-dc9a-41f1-bc4f-1d376308effc req-2f574946-7a34-4677-a9d0-2a69f3b2a31c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.0731602 Nov 16 03:18:42.661287 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a239d806-dc9a-41f1-bc4f-1d376308effc req-4b4a0fce-4e5d-4e6d-b1cc-7d28b3e83b54 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509355 Nov 16 03:18:42.993162 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef8e05d-4640-4ce2-8a03-f29b7e2ad684 req-0892fa67-f4f5-4036-9125-bb51dff527f8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:42.996143 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fef8e05d-4640-4ce2-8a03-f29b7e2ad684 req-0892fa67-f4f5-4036-9125-bb51dff527f8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 945 time: 0.0689864 Nov 16 03:18:43.102206 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fef8e05d-4640-4ce2-8a03-f29b7e2ad684 req-e47143c5-dacc-4357-9517-75ac8f3248fb tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956933 Nov 16 03:18:43.297661 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a226697e-18a4-4808-84d1-c67a95e754e6 req-ac3ff068-f702-4b48-8b25-afc32bd9c1f3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:43.299267 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a226697e-18a4-4808-84d1-c67a95e754e6 req-ac3ff068-f702-4b48-8b25-afc32bd9c1f3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0636370 Nov 16 03:18:43.358500 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a226697e-18a4-4808-84d1-c67a95e754e6 req-803eb870-cac8-4eea-a7a2-00a0d390f6c9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487299 Nov 16 03:18:43.836141 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e508c7c-de7f-4680-9a07-dfb0e05e9238 req-0b6258bc-f3cd-4574-9d62-45ec22096534 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:43.837777 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4e508c7c-de7f-4680-9a07-dfb0e05e9238 req-0b6258bc-f3cd-4574-9d62-45ec22096534 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.0604026 Nov 16 03:18:43.908171 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4e508c7c-de7f-4680-9a07-dfb0e05e9238 req-7e82652a-4726-4097-9419-6c6e5143242a tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531700 Nov 16 03:18:44.278875 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bfb503-b20a-487a-8410-ab450752eaba req-c3e85f88-80e7-4b99-8cc8-80f493f3dbd5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:44.281603 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-19bfb503-b20a-487a-8410-ab450752eaba req-c3e85f88-80e7-4b99-8cc8-80f493f3dbd5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 945 time: 0.0781114 Nov 16 03:18:44.344560 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-19bfb503-b20a-487a-8410-ab450752eaba req-e18ca0a2-b480-4733-84f7-4e1289aab176 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551322 Nov 16 03:18:44.368243 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-07135645-0bea-4340-b2ad-19ef461c5f2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:44.552074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f50a62-0e8d-4c92-969c-4411d6cce6d4 req-0be99ceb-7806-47e6-8b3e-0f8046f737e3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:44.553691 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-38f50a62-0e8d-4c92-969c-4411d6cce6d4 req-0be99ceb-7806-47e6-8b3e-0f8046f737e3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0632846 Nov 16 03:18:44.610050 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-38f50a62-0e8d-4c92-969c-4411d6cce6d4 req-94007b55-c15e-425b-9309-bd83827cdc31 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498614 Nov 16 03:18:45.055694 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2592bbb3-73ad-4b16-a2ed-17fea800752b req-8db87cdb-6583-4b9f-8810-3b54d0e26016 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:45.057472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2592bbb3-73ad-4b16-a2ed-17fea800752b req-8db87cdb-6583-4b9f-8810-3b54d0e26016 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.0542417 Nov 16 03:18:45.129376 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2592bbb3-73ad-4b16-a2ed-17fea800752b req-1666bde2-52b7-4ff1-b137-02df79270ce0 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614517 Nov 16 03:18:45.516925 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b93e29-f3b9-498d-a4ae-33fcd2ef4d42 req-bd4e2cf1-a34c-4ac8-865f-da01189f1b53 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:45.518877 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e5b93e29-f3b9-498d-a4ae-33fcd2ef4d42 req-bd4e2cf1-a34c-4ac8-865f-da01189f1b53 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 945 time: 0.0641875 Nov 16 03:18:45.616926 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e5b93e29-f3b9-498d-a4ae-33fcd2ef4d42 req-0fee6ddd-823a-481b-b288-c52f1159f0c7 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871606 Nov 16 03:18:45.705815 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['259ab0c6-cf7d-4e66-abd2-94758341d45b'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:45.759550 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f1d77ef-45b7-4ed8-b465-7bd46eb23bcc req-6b1bd6e6-5cd9-4eef-a37c-3d87d219da74 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:45.761632 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1f1d77ef-45b7-4ed8-b465-7bd46eb23bcc req-6b1bd6e6-5cd9-4eef-a37c-3d87d219da74 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0654309 Nov 16 03:18:45.855346 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1f1d77ef-45b7-4ed8-b465-7bd46eb23bcc req-64418f9d-5476-403d-a9a1-c64977e417c4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801346 Nov 16 03:18:46.538778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9de509a4-f0d8-4481-a49a-d49ffb4f7e4f req-02192055-3bab-42be-9bdc-7bdd0810a4f2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:46.540337 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9de509a4-f0d8-4481-a49a-d49ffb4f7e4f req-02192055-3bab-42be-9bdc-7bdd0810a4f2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.3283942 Nov 16 03:18:46.594824 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9de509a4-f0d8-4481-a49a-d49ffb4f7e4f req-9a2f3c22-5989-4013-ba09-d1a78a89319f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473280 Nov 16 03:18:46.769529 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa4b876a-6543-4d4c-bc5f-55d3bc5e88cf req-101207dc-abd8-4d0a-9e3a-72b1ef141afa tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:46.771280 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fa4b876a-6543-4d4c-bc5f-55d3bc5e88cf req-101207dc-abd8-4d0a-9e3a-72b1ef141afa tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 945 time: 0.0642107 Nov 16 03:18:46.850405 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fa4b876a-6543-4d4c-bc5f-55d3bc5e88cf req-fe57dbe5-0705-46df-ad26-dd393b68b31c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702927 Nov 16 03:18:47.018444 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13dc7c63-03ca-42b9-8980-c59eaa72882c req-f5e81b98-3c4c-48e5-9ff3-2b8d675e442f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:47.023007 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13dc7c63-03ca-42b9-8980-c59eaa72882c req-f5e81b98-3c4c-48e5-9ff3-2b8d675e442f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0851922 Nov 16 03:18:47.105536 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13dc7c63-03ca-42b9-8980-c59eaa72882c req-bbc39be3-a5d3-42d2-b6b1-8099010e660e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735638 Nov 16 03:18:47.363990 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 44224) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:47.537855 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-cff0a943-1677-4dee-b715-047ece2f3253 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=9dd17d33e39d4d719a978fe26d5ccb1d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1721764 Nov 16 03:18:47.541111 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 44232) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:18:47.612200 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b4a69bd-bc40-486c-96ff-95ce1a9de181 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:47.658377 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b4a69bd-bc40-486c-96ff-95ce1a9de181 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:47.777859 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b4a69bd-bc40-486c-96ff-95ce1a9de181 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:47.783357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8b4a69bd-bc40-486c-96ff-95ce1a9de181 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:47.787783 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8b4a69bd-bc40-486c-96ff-95ce1a9de181 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/863b996c-1f86-4d65-8290-cdc1eee31ce2 HTTP/1.1" status: 204 len: 168 time: 0.2432125 Nov 16 03:18:47.806287 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4a69bd-bc40-486c-96ff-95ce1a9de181 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=863b996c-1f86-4d65-8290-cdc1eee31ce2,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:47.840485 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68a9ac8-3d27-48da-be2c-f7a4f07b778f req-577bb09e-8ff1-43ad-a8d8-fd0b1ec8624f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:47.842839 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c68a9ac8-3d27-48da-be2c-f7a4f07b778f req-577bb09e-8ff1-43ad-a8d8-fd0b1ec8624f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 943 time: 0.1254485 Nov 16 03:18:47.918997 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c68a9ac8-3d27-48da-be2c-f7a4f07b778f req-ae0e38e7-e5f1-4b5b-a428-c4a26cf32588 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657859 Nov 16 03:18:48.000780 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd27038-59ae-492b-a48b-17ad6da24012 req-c56d25d5-3523-42bc-b477-5005fd8235f8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:48.002628 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ddd27038-59ae-492b-a48b-17ad6da24012 req-c56d25d5-3523-42bc-b477-5005fd8235f8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 945 time: 0.0588262 Nov 16 03:18:48.048485 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 3d8fe632-f146-4e90-a336-fff78b854aa3 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:18:48.054137 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ddd27038-59ae-492b-a48b-17ad6da24012 req-8605e5a5-e58e-49ba-b273-e8ebffcda64e tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453043 Nov 16 03:18:48.069419 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 259ab0c6-cf7d-4e66-abd2-94758341d45b up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:18:48.184334 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 259ab0c6-cf7d-4e66-abd2-94758341d45b completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:18:48.199470 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 259ab0c6-cf7d-4e66-abd2-94758341d45b triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:18:48.199815 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:48.238557 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 3d8fe632-f146-4e90-a336-fff78b854aa3, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=3d8fe632-f146-4e90-a336-fff78b854aa3,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:48.258870 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '3d8fe632-f146-4e90-a336-fff78b854aa3', 'network_id': '64a8f161-35b6-4fac-a77e-b81459bbc083', 'port_id': '3d8fe632-f146-4e90-a336-fff78b854aa3', 'mac_address': 'fa:16:3e:ea:64:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3f3c14a6-0800-4695-88cb-f795756f0d94', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:18:48.268703 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b176c87-254d-40ba-b5b9-4a4b79135288 req-70e3c55b-7718-4e40-a8b9-12eae3e4cb3d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:48.272148 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2b176c87-254d-40ba-b5b9-4a4b79135288 req-70e3c55b-7718-4e40-a8b9-12eae3e4cb3d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0688565 Nov 16 03:18:48.333085 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:48.366849 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3d8fe632-f146-4e90-a336-fff78b854aa3 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:18:48.375266 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2b176c87-254d-40ba-b5b9-4a4b79135288 req-8fbd2bbb-c4e2-4da6-ae47-c7f27ea63bce tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0829651 Nov 16 03:18:48.377618 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:48.402833 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 3d8fe632-f146-4e90-a336-fff78b854aa3, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=3d8fe632-f146-4e90-a336-fff78b854aa3,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:48.411875 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:48.420404 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '259ab0c6-cf7d-4e66-abd2-94758341d45b'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:48.422744 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66bbbfd6-8b59-4d44-9921-f77849e7f4f4" -d '{"events": [{"server_uuid": "5fdf0855-de57-4e84-ba51-6e27db495f65", "name": "network-vif-plugged", "status": "completed", "tag": "259ab0c6-cf7d-4e66-abd2-94758341d45b"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:48.475793 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 259ab0c6-cf7d-4e66-abd2-94758341d45b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=259ab0c6-cf7d-4e66-abd2-94758341d45b,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:48.478303 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-028a892f-c83f-4574-a7f9-6150f0daa4df x-openstack-request-id: req-028a892f-c83f-4574-a7f9-6150f0daa4df {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:48.479072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5fdf0855-de57-4e84-ba51-6e27db495f65", "name": "network-vif-plugged", "status": "completed", "tag": "259ab0c6-cf7d-4e66-abd2-94758341d45b", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:48.479582 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-028a892f-c83f-4574-a7f9-6150f0daa4df {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:48.479996 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '259ab0c6-cf7d-4e66-abd2-94758341d45b', 'code': 200} Nov 16 03:18:48.490873 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:48.509893 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b004b494-91e3-4c69-a9cf-214134dabb63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:48.516559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=3d8fe632-f146-4e90-a336-fff78b854aa3,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:48.589167 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=259ab0c6-cf7d-4e66-abd2-94758341d45b,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:48.741543 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26a7f94-1f3c-4245-90c9-9f4e06593232 req-d15fde04-ff18-4539-8502-8d24a1619b94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:48.743160 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e26a7f94-1f3c-4245-90c9-9f4e06593232 req-d15fde04-ff18-4539-8502-8d24a1619b94 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 1099 time: 0.0518548 Nov 16 03:18:48.821177 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e26a7f94-1f3c-4245-90c9-9f4e06593232 req-8e4c9baf-69eb-4cd1-8a7e-5fe050c23569 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674067 Nov 16 03:18:48.894375 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['3d8fe632-f146-4e90-a336-fff78b854aa3'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:18:49.080673 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6177588-27c7-4072-b245-26b15e61be87 req-0e058f9e-61b3-4ddc-bf13-6881e5147448 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:49.088649 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b6177588-27c7-4072-b245-26b15e61be87 req-0e058f9e-61b3-4ddc-bf13-6881e5147448 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 944 time: 0.0736585 Nov 16 03:18:49.166282 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b6177588-27c7-4072-b245-26b15e61be87 req-602daf91-5d4d-4979-be4d-6162b367ff02 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764110 Nov 16 03:18:49.287242 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a13d517-f1a7-4646-af64-6279bfcd664d req-5f12ed78-17e6-4873-a6ff-a34bf968bd0d tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:49.289231 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8a13d517-f1a7-4646-af64-6279bfcd664d req-5f12ed78-17e6-4873-a6ff-a34bf968bd0d tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0895982 Nov 16 03:18:49.357776 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8a13d517-f1a7-4646-af64-6279bfcd664d req-75bc82ad-628d-4175-bf67-0967e073331f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606241 Nov 16 03:18:49.498071 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4aff367-7fe0-4c21-a3bd-ef94a7b703c3 req-8fe6a58c-8cf7-4f20-b61c-ed4de11a8a9f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:49.499325 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d4aff367-7fe0-4c21-a3bd-ef94a7b703c3 req-8fe6a58c-8cf7-4f20-b61c-ed4de11a8a9f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0549555 Nov 16 03:18:49.550327 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d4aff367-7fe0-4c21-a3bd-ef94a7b703c3 req-d6bd2450-330e-44b7-9c04-101e21f88df9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443840 Nov 16 03:18:49.745974 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:50.294909 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ecb36ab-88ce-4962-828a-e5c77a586866 req-485401b9-90b3-4b80-aebd-39590d5bfff2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:50.296540 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2ecb36ab-88ce-4962-828a-e5c77a586866 req-485401b9-90b3-4b80-aebd-39590d5bfff2 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 944 time: 0.0517654 Nov 16 03:18:50.352369 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2ecb36ab-88ce-4962-828a-e5c77a586866 req-9f44c2c6-5b01-4492-b4f3-5ac6458f48df tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494134 Nov 16 03:18:50.495655 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f87ac565-4d35-446c-937a-b14c5e688010 req-68d28f64-895e-4b2d-a5f0-ff5b4f050993 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:50.498837 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f87ac565-4d35-446c-937a-b14c5e688010 req-68d28f64-895e-4b2d-a5f0-ff5b4f050993 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0684528 Nov 16 03:18:50.567312 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f87ac565-4d35-446c-937a-b14c5e688010 req-89560eaa-b6f5-4c49-894b-fa0fcb9b9948 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596890 Nov 16 03:18:50.681783 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a077f132-3558-46a2-99d2-d3ddae4f26f5 req-2a8bcf49-e8a5-4ae1-8c28-600d47da0f76 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:50.683701 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a077f132-3558-46a2-99d2-d3ddae4f26f5 req-2a8bcf49-e8a5-4ae1-8c28-600d47da0f76 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0580330 Nov 16 03:18:50.737653 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a077f132-3558-46a2-99d2-d3ddae4f26f5 req-fc727e53-9a4b-4ccc-abbb-cdf0c8dee0dc tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469079 Nov 16 03:18:51.483473 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:51.496740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfdf217c-7fc9-415d-948e-81877dc13f17 req-0467581c-449b-483c-9f7b-d74a7d034f44 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:51.498342 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cfdf217c-7fc9-415d-948e-81877dc13f17 req-0467581c-449b-483c-9f7b-d74a7d034f44 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 944 time: 0.0571928 Nov 16 03:18:51.555767 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cfdf217c-7fc9-415d-948e-81877dc13f17 req-c7a79464-7470-4bf7-8b89-1b2484ca555b tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507851 Nov 16 03:18:51.610406 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:51.707979 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465b0d57-85b6-4b3a-91ec-39a18d754376 req-5cd6376a-9305-4df7-8eb7-5811b5bae30b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:51.709718 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-465b0d57-85b6-4b3a-91ec-39a18d754376 req-5cd6376a-9305-4df7-8eb7-5811b5bae30b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0534899 Nov 16 03:18:51.774645 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-465b0d57-85b6-4b3a-91ec-39a18d754376 req-157a7d7e-99d7-437a-8b1d-5fdb7df008d5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571311 Nov 16 03:18:51.895866 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74eebd90-a5fd-44c3-af5d-f904f9aab2b0 req-163dc7e1-fcfd-4ae2-8356-5f1ae6f407ed tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:51.898443 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74eebd90-a5fd-44c3-af5d-f904f9aab2b0 req-163dc7e1-fcfd-4ae2-8356-5f1ae6f407ed tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0858405 Nov 16 03:18:51.964411 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74eebd90-a5fd-44c3-af5d-f904f9aab2b0 req-38054ea0-1cd9-43a7-a431-92c2e778f14e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590138 Nov 16 03:18:52.723828 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4272b93b-832e-43f7-b4ad-626ecb3335c4 req-247432cc-19b5-4645-93ef-4b7607d05761 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:52.725335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4272b93b-832e-43f7-b4ad-626ecb3335c4 req-247432cc-19b5-4645-93ef-4b7607d05761 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 944 time: 0.0502820 Nov 16 03:18:52.782444 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4272b93b-832e-43f7-b4ad-626ecb3335c4 req-d3ac31c7-0b1a-4e16-b673-c19a0f2ed8e4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504963 Nov 16 03:18:52.906341 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f77ea8b2-f10a-4d8c-a1ed-8a49a649b002 req-f2f593a1-7924-4faf-a27f-32311ad85153 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:52.907806 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f77ea8b2-f10a-4d8c-a1ed-8a49a649b002 req-f2f593a1-7924-4faf-a27f-32311ad85153 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0552313 Nov 16 03:18:52.967602 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f77ea8b2-f10a-4d8c-a1ed-8a49a649b002 req-eab02fd8-c240-4e6c-9cf4-602c469bf5aa tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529366 Nov 16 03:18:53.086520 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1646ed07-b67f-4ef1-b82b-99a30c75cfb4 req-0c7d5c0f-02e3-451e-9f52-b88c13ba7bcb tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:53.088061 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1646ed07-b67f-4ef1-b82b-99a30c75cfb4 req-0c7d5c0f-02e3-451e-9f52-b88c13ba7bcb tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0529904 Nov 16 03:18:53.146249 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1646ed07-b67f-4ef1-b82b-99a30c75cfb4 req-37aa1cb4-fd58-4bcd-a461-ca304aa33977 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517831 Nov 16 03:18:53.920013 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f131e8-b3e6-4c89-82db-fade29645ca5 req-c64dc23e-b438-45c4-887d-6579bc840bf7 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:53.921634 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-61f131e8-b3e6-4c89-82db-fade29645ca5 req-c64dc23e-b438-45c4-887d-6579bc840bf7 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 944 time: 0.0503473 Nov 16 03:18:53.963389 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:18:53.975280 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-61f131e8-b3e6-4c89-82db-fade29645ca5 req-1a2c965b-d816-47df-be79-00fe734dae87 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443122 Nov 16 03:18:54.062517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 3d8fe632-f146-4e90-a336-fff78b854aa3 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:18:54.125775 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a395575-9fbb-4c33-ba56-057b4ebe19b0 req-66b910d1-10b5-4592-8c83-19f7067690e4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:54.125775 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a395575-9fbb-4c33-ba56-057b4ebe19b0 req-66b910d1-10b5-4592-8c83-19f7067690e4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0600410 Nov 16 03:18:54.127555 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 3d8fe632-f146-4e90-a336-fff78b854aa3 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:18:54.141472 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 3d8fe632-f146-4e90-a336-fff78b854aa3 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:18:54.141842 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:54.191157 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a395575-9fbb-4c33-ba56-057b4ebe19b0 req-0bb38907-657c-4f2b-9eac-b0e186c333b1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612776 Nov 16 03:18:54.230133 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:54.267329 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d8fe632-f146-4e90-a336-fff78b854aa3'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:18:54.271444 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6095f1d-51cf-4d59-b6e5-a040fe4384f3" -d '{"events": [{"server_uuid": "e2586444-2ca8-418e-aadc-59a07a8ae2ae", "name": "network-vif-plugged", "status": "completed", "tag": "3d8fe632-f146-4e90-a336-fff78b854aa3"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:18:54.279055 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4496b948-f890-4650-9d79-670a791495bc req-5fcd7613-e7ad-4999-9829-878dfc155020 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:54.280500 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4496b948-f890-4650-9d79-670a791495bc req-5fcd7613-e7ad-4999-9829-878dfc155020 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0601633 Nov 16 03:18:54.299938 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 3d8fe632-f146-4e90-a336-fff78b854aa3, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=3d8fe632-f146-4e90-a336-fff78b854aa3,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:18:54.308794 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:18:54.338521 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:18:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed4e7e8e-fc8c-4550-bb84-94072c1d25cb x-openstack-request-id: req-ed4e7e8e-fc8c-4550-bb84-94072c1d25cb {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:18:54.338840 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e2586444-2ca8-418e-aadc-59a07a8ae2ae", "name": "network-vif-plugged", "status": "completed", "tag": "3d8fe632-f146-4e90-a336-fff78b854aa3", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:18:54.339178 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ed4e7e8e-fc8c-4550-bb84-94072c1d25cb {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:18:54.339572 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d8fe632-f146-4e90-a336-fff78b854aa3', 'code': 200} Nov 16 03:18:54.340530 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4496b948-f890-4650-9d79-670a791495bc req-5609a4df-3a59-48ca-8c60-1f23b66bd4e3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520141 Nov 16 03:18:54.378157 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=3d8fe632-f146-4e90-a336-fff78b854aa3,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:18:55.097688 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac3cb98-bd04-4ca4-8be2-b676ba676c52 req-639c4289-cbcf-4a01-a22d-ecd62dcb21ad tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:55.099155 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0ac3cb98-bd04-4ca4-8be2-b676ba676c52 req-639c4289-cbcf-4a01-a22d-ecd62dcb21ad tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0518985 Nov 16 03:18:55.158710 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0ac3cb98-bd04-4ca4-8be2-b676ba676c52 req-3e86e025-d8b9-421e-ac69-fe8527398430 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535269 Nov 16 03:18:55.478118 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71164904-2357-4c3d-b119-d6fcbecdba17 req-ede1b09f-a2fb-4557-a9da-415c2092668f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:55.479789 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-71164904-2357-4c3d-b119-d6fcbecdba17 req-ede1b09f-a2fb-4557-a9da-415c2092668f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0555658 Nov 16 03:18:55.541943 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-71164904-2357-4c3d-b119-d6fcbecdba17 req-4b22cffa-8fea-4afc-a31d-0c68f05d3e03 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511117 Nov 16 03:18:56.286097 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff34de78-139b-4e3a-8596-c809cb5133df req-d52914ff-43ed-4263-99da-ea6157bfb3d5 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:56.287587 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ff34de78-139b-4e3a-8596-c809cb5133df req-d52914ff-43ed-4263-99da-ea6157bfb3d5 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0528836 Nov 16 03:18:56.345892 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ff34de78-139b-4e3a-8596-c809cb5133df req-0a68786c-dc04-4805-a767-2dd2fd0e9b2c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501368 Nov 16 03:18:56.679942 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca9b1a-a929-489e-8a7d-c3088e1f03d9 req-fc515d49-9c74-48a0-b6c1-c7271834c0fc tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:56.681508 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8ca9b1a-a929-489e-8a7d-c3088e1f03d9 req-fc515d49-9c74-48a0-b6c1-c7271834c0fc tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0599289 Nov 16 03:18:56.729667 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8ca9b1a-a929-489e-8a7d-c3088e1f03d9 req-fd417cf5-005e-4232-8987-41b72cc9cb2e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417793 Nov 16 03:18:57.491571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd677dd3-3c0a-49d8-9378-ca3ad7e0d825 req-17eb5fba-e380-4d7e-b0a0-a492b5a0f71d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:57.493051 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd677dd3-3c0a-49d8-9378-ca3ad7e0d825 req-17eb5fba-e380-4d7e-b0a0-a492b5a0f71d tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0665154 Nov 16 03:18:57.552256 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756ea92a-f1d2-4c77-b051-14ac9f735c03 req-cdb4d2ab-8141-4f0e-b5e4-03e749288680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:57.553735 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-756ea92a-f1d2-4c77-b051-14ac9f735c03 req-cdb4d2ab-8141-4f0e-b5e4-03e749288680 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 1098 time: 0.0783498 Nov 16 03:18:57.570406 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd677dd3-3c0a-49d8-9378-ca3ad7e0d825 req-330faebb-3714-406b-a6b2-3f4bdb498a3c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602329 Nov 16 03:18:57.608076 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-756ea92a-f1d2-4c77-b051-14ac9f735c03 req-4df40678-81ba-4536-b770-5266396574b8 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454741 Nov 16 03:18:57.864173 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc5f720-24e0-4a6a-97a4-5d3b32d47908 req-de536662-3f14-4864-bd70-fcde22f8d96b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:57.865860 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-afc5f720-24e0-4a6a-97a4-5d3b32d47908 req-de536662-3f14-4864-bd70-fcde22f8d96b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0631669 Nov 16 03:18:57.923261 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-afc5f720-24e0-4a6a-97a4-5d3b32d47908 req-f9516a96-2818-4788-8002-3f347b8be4f5 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500050 Nov 16 03:18:58.701596 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-296dcdcc-f65d-49c9-862a-9b3544a118f6 req-c36e1106-6459-4d72-8561-e33cba691961 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:58.703135 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-296dcdcc-f65d-49c9-862a-9b3544a118f6 req-c36e1106-6459-4d72-8561-e33cba691961 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0583255 Nov 16 03:18:58.757028 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-296dcdcc-f65d-49c9-862a-9b3544a118f6 req-ccf66912-e593-46fd-b580-3f165d5a31c3 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445075 Nov 16 03:18:59.107759 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8849ef02-de62-4308-b375-2f703c8e6dc0 req-7236728f-869d-45ba-8a43-391767b80c69 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:59.110513 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8849ef02-de62-4308-b375-2f703c8e6dc0 req-7236728f-869d-45ba-8a43-391767b80c69 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0737379 Nov 16 03:18:59.196280 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8849ef02-de62-4308-b375-2f703c8e6dc0 req-01b6ef34-5bf3-43b2-b4b5-2422c06d3291 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730817 Nov 16 03:18:59.890245 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec767f8-2ed4-4e42-8d0b-3a0cf0070bac req-7fc75289-c00b-485f-ab90-7bc1b2ee1449 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:18:59.891802 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eec767f8-2ed4-4e42-8d0b-3a0cf0070bac req-7fc75289-c00b-485f-ab90-7bc1b2ee1449 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0527463 Nov 16 03:18:59.963214 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eec767f8-2ed4-4e42-8d0b-3a0cf0070bac req-b3d1b428-c0c9-4ec9-81b1-69474f774e24 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595727 Nov 16 03:18:59.998742 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea1c6a3-ef8d-443b-aed6-3f47ea939409 req-e12702e9-5b90-4d49-baa0-57ebea611712 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:00.000446 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea1c6a3-ef8d-443b-aed6-3f47ea939409 req-e12702e9-5b90-4d49-baa0-57ebea611712 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.0544631 Nov 16 03:19:00.051570 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7ea1c6a3-ef8d-443b-aed6-3f47ea939409 req-1aa9f92e-94cf-43c6-812d-bc71600a5ddc service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420954 Nov 16 03:19:00.317661 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ba2b641-156d-4ae4-819a-31953a7710aa req-f8ca988a-8c50-49db-811e-4399a5d80ab0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:00.319079 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1ba2b641-156d-4ae4-819a-31953a7710aa req-f8ca988a-8c50-49db-811e-4399a5d80ab0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0539424 Nov 16 03:19:00.370786 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1ba2b641-156d-4ae4-819a-31953a7710aa req-d5e21f72-0047-4fa6-a11e-972dbb8d1812 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444832 Nov 16 03:19:01.115663 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-b28e587e-ef7c-48e9-826f-d413afbc6e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:01.117052 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-b28e587e-ef7c-48e9-826f-d413afbc6e89 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.0419004 Nov 16 03:19:01.240609 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-5bb873ef-c459-46bc-a7bf-d88fe8a033f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:01.242192 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-5bb873ef-c459-46bc-a7bf-d88fe8a033f0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.0945337 Nov 16 03:19:01.285565 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-625b2972-e034-4950-9013-d8207f721408 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.0347981 Nov 16 03:19:01.340411 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-ab196a52-e4bc-4a18-8814-5d2b242d5a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:01.341881 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-ab196a52-e4bc-4a18-8814-5d2b242d5a71 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.0471029 Nov 16 03:19:01.375357 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-ed9ba76c-b827-416c-935e-6cafadc75eb0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253806 Nov 16 03:19:01.542654 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e9bfd75-5856-4dca-86d8-5c75fc93a6e2 req-df08f7ca-9459-48eb-9f7e-22ec20a3334f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:01.544290 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e9bfd75-5856-4dca-86d8-5c75fc93a6e2 req-df08f7ca-9459-48eb-9f7e-22ec20a3334f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0978246 Nov 16 03:19:01.624639 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-970f1b68-80cc-41d9-beeb-a032f6382d85 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1443675 Nov 16 03:19:01.628363 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e9bfd75-5856-4dca-86d8-5c75fc93a6e2 req-ee7e504f-d605-49dd-a95e-e49305bb2c63 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755956 Nov 16 03:19:01.734716 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54e171af-bd2d-45d0-b8ff-45b70269d237 req-8b052a86-7d01-40f4-8db0-8112e4c7f12c service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1011152 Nov 16 03:19:02.272455 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 44536) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:02.305073 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c1e9b2-7014-4db5-8508-b12ed2e0c841 req-bae42b9a-2291-46d6-9164-8f4e04b09f1f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:02.306865 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17c1e9b2-7014-4db5-8508-b12ed2e0c841 req-bae42b9a-2291-46d6-9164-8f4e04b09f1f tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0544062 Nov 16 03:19:02.359993 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17c1e9b2-7014-4db5-8508-b12ed2e0c841 req-01e41c71-dc76-4aae-a617-6908c6f58b05 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455220 Nov 16 03:19:02.403082 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.486414 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.492710 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.529469 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fcf4e6fb-7395-4473-938c-185437c415cd,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:02.533359 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=40e3b27937b94ecfac741effc17cc499&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2598805 Nov 16 03:19:02.536915 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 44540) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:02.539510 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.539861 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.540203 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.540531 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.540852 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.541177 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.541521 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.541841 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.542157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.542530 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.542884 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.543379 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77de7e0b-9963-443a-9f8d-3eeded3af9e4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.588346 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.612184 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.670917 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.673489 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:02.679062 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fcf4e6fb-7395-4473-938c-185437c415cd HTTP/1.1" status: 204 len: 168 time: 0.1393449 Nov 16 03:19:02.687329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcf4e6fb-7395-4473-938c-185437c415cd,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:02.695200 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.695941 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.695941 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.696310 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.696653 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.696980 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.697920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.697920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.698133 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.698374 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.698763 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.699251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-610be962-f7fb-4f14-9a1c-f79a672b8687 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:02.775808 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed6dc94-eca9-413f-8173-20a0dd6fac49 req-99361a84-613d-482c-b1a4-be1194e6c814 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:02.778206 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6ed6dc94-eca9-413f-8173-20a0dd6fac49 req-99361a84-613d-482c-b1a4-be1194e6c814 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0598092 Nov 16 03:19:02.839733 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6ed6dc94-eca9-413f-8173-20a0dd6fac49 req-8dca8101-c556-47fe-9120-667d5b7b708d tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545893 Nov 16 03:19:03.185864 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f671fc-318a-49a6-a917-c483ce9edfa4 req-2b1d548a-b1ae-46b7-b668-188fee66b36c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:03.188545 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-45f671fc-318a-49a6-a917-c483ce9edfa4 req-2b1d548a-b1ae-46b7-b668-188fee66b36c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0728831 Nov 16 03:19:03.299800 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-25db1c08-7e95-4df8-8b31-3d8ff282a25f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:03.301325 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-25db1c08-7e95-4df8-8b31-3d8ff282a25f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.1114802 Nov 16 03:19:03.305257 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-45f671fc-318a-49a6-a917-c483ce9edfa4 req-c83184f4-1363-4fc6-a949-79f1cc530ede tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004639 Nov 16 03:19:03.424438 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-f85599ab-1f61-4d26-970e-43737ebfc236 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:03.426114 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-f85599ab-1f61-4d26-970e-43737ebfc236 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.1115925 Nov 16 03:19:03.489786 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-22d9c32e-dda3-4bdd-b3de-e296cb47d1da service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.0475841 Nov 16 03:19:03.592338 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-bcf29778-7055-4c90-9b71-7ae3d2625063 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:03.593871 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-bcf29778-7055-4c90-9b71-7ae3d2625063 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.0919566 Nov 16 03:19:03.615194 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234222f1-8586-48c3-b9cd-8218f0a135a1 req-daf8eeb1-149a-44da-a721-0e102bc34250 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:03.617136 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-234222f1-8586-48c3-b9cd-8218f0a135a1 req-daf8eeb1-149a-44da-a721-0e102bc34250 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.1302309 Nov 16 03:19:03.650260 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-813e8edd-7cd7-4556-bdc7-a5e4ebea98d5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0319197 Nov 16 03:19:03.716511 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 44576) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:03.735516 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-234222f1-8586-48c3-b9cd-8218f0a135a1 req-5da58c61-b606-446a-bee8-c9d85db85dfa tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1091952 Nov 16 03:19:03.797076 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-7346328a-9ac9-4b2b-9cd3-ee8a083c75e4 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1211903 Nov 16 03:19:03.856048 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-70f561c8-2a7f-4cae-834c-e0d418b365ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:03.915802 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e463b90b-1d60-42d9-aa4d-972dc11e8e5f req-ddf5a8a4-5e8b-47f6-aca5-4c1ef7a412f0 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1011374 Nov 16 03:19:03.945798 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-70f561c8-2a7f-4cae-834c-e0d418b365ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:03.952257 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-70f561c8-2a7f-4cae-834c-e0d418b365ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:03.997155 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-70f561c8-2a7f-4cae-834c-e0d418b365ba admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a5a179aaf0f641299382a1908d49dce7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2794237 Nov 16 03:19:03.998382 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f561c8-2a7f-4cae-834c-e0d418b365ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e56558fe-6b36-44ff-9000-ee07033b4b09,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:04.000184 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 44582) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:04.061377 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cc956817-19db-4769-8839-177e59b38aff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:04.090952 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cc956817-19db-4769-8839-177e59b38aff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:04.149265 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cc956817-19db-4769-8839-177e59b38aff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:04.152738 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cc956817-19db-4769-8839-177e59b38aff admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:04.158276 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-cc956817-19db-4769-8839-177e59b38aff admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/e56558fe-6b36-44ff-9000-ee07033b4b09 HTTP/1.1" status: 204 len: 168 time: 0.1568015 Nov 16 03:19:04.168526 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc956817-19db-4769-8839-177e59b38aff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e56558fe-6b36-44ff-9000-ee07033b4b09,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:04.448414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a528fa-885e-46ab-ac09-b82dfd079afd req-9afd9b91-e399-44d9-aab9-cb390f96022b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:04.450294 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d0a528fa-885e-46ab-ac09-b82dfd079afd req-9afd9b91-e399-44d9-aab9-cb390f96022b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0594194 Nov 16 03:19:04.518363 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d0a528fa-885e-46ab-ac09-b82dfd079afd req-232b5d95-0526-48e1-88c8-bd704ecb4966 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575163 Nov 16 03:19:05.020196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f4f9d3e-b83d-4e5d-b24e-292b74f21fde req-bf052ccc-3b87-4d07-84bb-9c8eb8b119f7 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:05.021891 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f4f9d3e-b83d-4e5d-b24e-292b74f21fde req-bf052ccc-3b87-4d07-84bb-9c8eb8b119f7 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0515492 Nov 16 03:19:05.078303 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f4f9d3e-b83d-4e5d-b24e-292b74f21fde req-395b883a-9f16-48f9-99b2-728334bf81e4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/security-groups?id=eaaa09dd-6539-448f-b3ed-4a46282d5242&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499487 Nov 16 03:19:05.313020 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-e6c86c34-128a-410c-b45d-2390e40c5c7c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:05.313020 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-e6c86c34-128a-410c-b45d-2390e40c5c7c tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 945 time: 0.0591962 Nov 16 03:19:05.436923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Deleting port 3d8fe632-f146-4e90-a336-fff78b854aa3 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:19:05.437263 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:05.545851 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] For port 3d8fe632-f146-4e90-a336-fff78b854aa3, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=3d8fe632-f146-4e90-a336-fff78b854aa3,segment=NetworkSegment(f570f171-eae9-4b0b-8ea1-0350983b2fe0),segment_id=f570f171-eae9-4b0b-8ea1-0350983b2fe0)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:05.545851 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:05.559916 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Calling delete_port for 3d8fe632-f146-4e90-a336-fff78b854aa3 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:19:05.682766 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee86a15-c4f8-47bf-9dac-36c84d9a79f2 req-a30d7404-7491-4e95-8cc5-a7c7d585839e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:05.685033 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eee86a15-c4f8-47bf-9dac-36c84d9a79f2 req-a30d7404-7491-4e95-8cc5-a7c7d585839e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0825417 Nov 16 03:19:05.755792 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:05.776234 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eee86a15-c4f8-47bf-9dac-36c84d9a79f2 req-fc133588-97ef-4c10-b2b8-3b89bb6586e7 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850375 Nov 16 03:19:05.778152 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:05.810945 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Pushing event deleted for resources: {'Port': ['ID=3d8fe632-f146-4e90-a336-fff78b854aa3,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:05.823233 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['3d8fe632-f146-4e90-a336-fff78b854aa3'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:19:05.862067 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] No DVR routers for this DVR port 3d8fe632-f146-4e90-a336-fff78b854aa3 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:19:05.865107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:05.868515 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7451013-eb66-48e5-8e11-182d4c16b078 req-6eee6e18-81dc-4b99-af16-e4cbb92ecbe4 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.11 "DELETE /v2.0/ports/3d8fe632-f146-4e90-a336-fff78b854aa3 HTTP/1.1" status: 204 len: 173 time: 0.5499694 Nov 16 03:19:05.868969 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'name': 'network-vif-deleted', 'tag': '3d8fe632-f146-4e90-a336-fff78b854aa3'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:19:05.871882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e6b7703-5f2a-4e79-8a6c-f3701711d9ca" -d '{"events": [{"server_uuid": "e2586444-2ca8-418e-aadc-59a07a8ae2ae", "name": "network-vif-deleted", "tag": "3d8fe632-f146-4e90-a336-fff78b854aa3"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:19:05.913813 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:19:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-179fef89-2697-4ddd-9147-f5a3eaabbfac x-openstack-request-id: req-179fef89-2697-4ddd-9147-f5a3eaabbfac {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:19:05.914408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e2586444-2ca8-418e-aadc-59a07a8ae2ae", "name": "network-vif-deleted", "tag": "3d8fe632-f146-4e90-a336-fff78b854aa3", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:19:05.914844 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-179fef89-2697-4ddd-9147-f5a3eaabbfac {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:19:05.915403 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2586444-2ca8-418e-aadc-59a07a8ae2ae', 'name': 'network-vif-deleted', 'tag': '3d8fe632-f146-4e90-a336-fff78b854aa3', 'status': 'completed', 'code': 200} Nov 16 03:19:06.201266 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2f68fa80-1ef9-4207-bfe2-540728a8c31d req-4b976f9f-c320-4a28-92a0-391ba18c2aa3 tempest-VolumesActionsTest-602502148 tempest-VolumesActionsTest-602502148-project] 10.222.0.31 "GET /v2.0/ports?device_id=e2586444-2ca8-418e-aadc-59a07a8ae2ae HTTP/1.1" status: 200 len: 210 time: 0.0282488 Nov 16 03:19:06.919782 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421e43c4-831e-49ba-ad73-6043ab3720d7 req-a4484c8a-9b38-427b-9377-890fe5e87d2e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:06.921353 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-421e43c4-831e-49ba-ad73-6043ab3720d7 req-a4484c8a-9b38-427b-9377-890fe5e87d2e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0578215 Nov 16 03:19:06.973478 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-421e43c4-831e-49ba-ad73-6043ab3720d7 req-213beae8-99b7-4a5d-b2ba-91889a3d8dca tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458925 Nov 16 03:19:10.193356 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 3d8fe632-f146-4e90-a336-fff78b854aa3 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:19:10.217761 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 3d8fe632-f146-4e90-a336-fff78b854aa3 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:19:10.218105 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 3d8fe632-f146-4e90-a336-fff78b854aa3 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:19:14.373000 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-080bcdf5-3dac-4928-9c61-2d415967c930 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.024186 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc51419-3a4f-44e2-95d0-5a7bb25279c9 req-e5a6020c-b925-4d16-a9b9-c33835309e57 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:17.025722 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fc51419-3a4f-44e2-95d0-5a7bb25279c9 req-e5a6020c-b925-4d16-a9b9-c33835309e57 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0528834 Nov 16 03:19:17.077701 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fc51419-3a4f-44e2-95d0-5a7bb25279c9 req-b5d136d0-2b81-4374-9544-6408f1ea6f14 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455725 Nov 16 03:19:17.360096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 44888) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:17.512123 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-093f0708-d3f1-40b6-a60e-28beba1815bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.641834 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-093f0708-d3f1-40b6-a60e-28beba1815bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.646841 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-093f0708-d3f1-40b6-a60e-28beba1815bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.695627 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-093f0708-d3f1-40b6-a60e-28beba1815bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc48116a-005e-4db9-9480-7c109e082220,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:17.705275 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 44908) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:17.710423 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-093f0708-d3f1-40b6-a60e-28beba1815bf admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=f81429c756654be2bc5a5f8c93220d88&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3483174 Nov 16 03:19:17.784654 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e678304-4f31-4ecc-aa08-4df8c404812b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.816331 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e678304-4f31-4ecc-aa08-4df8c404812b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.873971 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e678304-4f31-4ecc-aa08-4df8c404812b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.876772 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e678304-4f31-4ecc-aa08-4df8c404812b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:17.878178 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-5e678304-4f31-4ecc-aa08-4df8c404812b admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fc48116a-005e-4db9-9480-7c109e082220 HTTP/1.1" status: 204 len: 168 time: 0.1719155 Nov 16 03:19:17.888383 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e678304-4f31-4ecc-aa08-4df8c404812b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc48116a-005e-4db9-9480-7c109e082220,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:18.461751 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-f6a7f83d-8cfe-4308-840b-edc34eeeb4e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:19.104664 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-48a78f72-4c0a-467d-a366-a8cddce0633d tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:19.106208 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-48a78f72-4c0a-467d-a366-a8cddce0633d tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.1231081 Nov 16 03:19:19.122746 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-f849c524-aaad-4eb4-a899-3f9385003748 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/quotas/61a2e084639344ff8e8d5ade2eef51d0 HTTP/1.1" status: 200 len: 375 time: 0.0095816 Nov 16 03:19:19.180646 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-1660c359-7738-4705-849c-063b90faaf97 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0518935 Nov 16 03:19:19.290826 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-2b5f6d5b-4f47-493b-a036-56b361996bcb service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1030233 Nov 16 03:19:19.453472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-05582fc7-e5ea-48b9-87f1-f21b373f5388 service neutron] 10.222.0.31 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1563592 Nov 16 03:19:19.648563 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-72c9ec43-ef12-46fd-b4ea-f1ff426cb66b req-2353db7c-4093-4ded-bbf4-947ad794b709 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0386252 Nov 16 03:19:19.759837 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:20.832117 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a53a5356-f4f4-48a4-abf5-b78ec25df5df req-308217ce-596b-4db6-842e-8c1b7e195f02 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0437706 Nov 16 03:19:21.495574 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:21.591073 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:21.937294 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a9d7074a-5396-4653-9ff3-a4a811fe09e8 req-e3b78cf6-3bff-4f85-944b-401e478cb8b3 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0301900 Nov 16 03:19:23.040539 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bfa378a0-036a-44b9-8f03-456dd186165f req-4c57f3ae-e995-4774-8b9d-b5ef9909ce5c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0277867 Nov 16 03:19:24.145457 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3872dc4-88f9-4f59-a229-05d7d856900a req-01636f68-32bf-4b31-ace4-608198b1abfb tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0269289 Nov 16 03:19:25.103454 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-197e4f70-6516-49ea-9a2e-559e26b8813a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:25.105335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-197e4f70-6516-49ea-9a2e-559e26b8813a tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 814 time: 0.3333476 Nov 16 03:19:25.133922 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Request body: {'port': {'device_id': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'admin_state_up': True, 'tenant_id': '61a2e084639344ff8e8d5ade2eef51d0'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:25.257221 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Made reservation on behalf of 61a2e084639344ff8e8d5ade2eef51d0 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:19:25.261544 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:25.279690 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ae27d715-86f7-4e15-aebe-ec271e44de25 req-4d6cf0d0-4fc8-46b5-80f8-9e0310daa834 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0345106 Nov 16 03:19:25.426428 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Allocated IP 172.20.0.13 (9a8436ad-09c6-4a61-8922-e3cc29d73f78/a3fb04df-83c0-4d51-afa7-1e0694c8dbc3/d415bab3-aa5f-4d8a-8710-dda8b0b824ce) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:25.619919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:25.661305 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:25.714617 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:25.718244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db', 'da96bbab-7015-473b-bb68-ef95db66868f', '259ab0c6-cf7d-4e66-abd2-94758341d45b'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:19:25.719139 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:25.721576 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:25.798987 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:25.799640 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:25.803644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event updated for resources: {'Port': ['ID=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:25.824493 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-d2d789eb-8170-4a53-b32c-613bab16aa91 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6943989 Nov 16 03:19:25.873347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Request body: {'port': {'device_id': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:25.934770 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:26.503616 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30bce855-7dfd-4c26-91e8-e413b5868cb9 req-b0aec03d-c092-4666-8143-fb92533bf9b1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:26.505453 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-30bce855-7dfd-4c26-91e8-e413b5868cb9 req-b0aec03d-c092-4666-8143-fb92533bf9b1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 932 time: 0.1216164 Nov 16 03:19:26.510030 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d415bab3-aa5f-4d8a-8710-dda8b0b824ce {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:19:26.520516 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:26.548972 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Transition to ACTIVE for port object d415bab3-aa5f-4d8a-8710-dda8b0b824ce will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:19:26.559821 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:26.630099 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-30bce855-7dfd-4c26-91e8-e413b5868cb9 req-4faca31e-a95d-4c00-a22d-d4dc5686bb3e tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1126058 Nov 16 03:19:26.671231 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Pushing event updated for resources: {'Port': ['ID=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:26.775568 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Attempting to bind port d415bab3-aa5f-4d8a-8710-dda8b0b824ce on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:26.775908 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Attempting to bind port d415bab3-aa5f-4d8a-8710-dda8b0b824ce by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:26.776237 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Attempting to bind port d415bab3-aa5f-4d8a-8710-dda8b0b824ce on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:26.787221 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Port d415bab3-aa5f-4d8a-8710-dda8b0b824ce on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:19:26.787591 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Attempting to bind port d415bab3-aa5f-4d8a-8710-dda8b0b824ce on network 9a8436ad-09c6-4a61-8922-e3cc29d73f78 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:26.795313 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:26.795720 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Checking segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:26.796099 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Bound using segment: {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:26.796529 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Bound port: d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '494aff95-079c-4b92-b4fa-97068bf0b02b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 327, 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:26.796882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:26.935024 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] For port d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:26.944748 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] For port d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:26.955993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb44366-ba9c-4c1b-bb83-9ad4b30b2c58 req-91996de9-593a-4977-ad7d-13cd8966e8b4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:26.957623 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-1139dc45-7d5c-4695-9487-500cda44216f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:26.959060 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6fb44366-ba9c-4c1b-bb83-9ad4b30b2c58 req-91996de9-593a-4977-ad7d-13cd8966e8b4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1033056 Nov 16 03:19:26.961724 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:26.965398 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-1139dc45-7d5c-4695-9487-500cda44216f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.1290798 Nov 16 03:19:27.034995 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:27.036894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:27.039180 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] 10.222.0.11 "PUT /v2.0/ports/d415bab3-aa5f-4d8a-8710-dda8b0b824ce HTTP/1.1" status: 200 len: 1094 time: 1.1706314 Nov 16 03:19:27.044798 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'tag': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:19:27.047451 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b3302c13-966e-468c-83af-b54f88ff753e" -d '{"events": [{"name": "network-changed", "server_uuid": "a955e82c-67c0-4f2f-a00d-4c784505cd9c", "tag": "d415bab3-aa5f-4d8a-8710-dda8b0b824ce"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:19:27.135647 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6fb44366-ba9c-4c1b-bb83-9ad4b30b2c58 req-483d1721-bfc7-42f9-8ca0-ec3dd0b06228 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1683860 Nov 16 03:19:27.200474 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:19:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-180ff1d8-ab2f-442d-80fc-0f271c7ff2c8 x-openstack-request-id: req-180ff1d8-ab2f-442d-80fc-0f271c7ff2c8 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:19:27.200914 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a955e82c-67c0-4f2f-a00d-4c784505cd9c", "tag": "d415bab3-aa5f-4d8a-8710-dda8b0b824ce", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:19:27.201166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-180ff1d8-ab2f-442d-80fc-0f271c7ff2c8 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:19:27.201594 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'tag': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce', 'status': 'completed', 'code': 200} Nov 16 03:19:27.211472 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91dd1c2-a07e-4b2d-80e0-9faf9fc3dc29 service neutron] Pushing event updated for resources: {'Port': ['ID=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:27.226133 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-7ea18dc6-ab71-4eff-a8c1-c88c539388b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:27.227673 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-7ea18dc6-ab71-4eff-a8c1-c88c539388b0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 1097 time: 0.1003988 Nov 16 03:19:27.268925 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-b16d7d6b-1780-4caa-a299-0c9b45755cbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:27.271066 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-b16d7d6b-1780-4caa-a299-0c9b45755cbd service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.2934368 Nov 16 03:19:27.322138 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-83af14f9-e1d4-4c0b-88b8-352b15439ab9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce HTTP/1.1" status: 200 len: 217 time: 0.0733654 Nov 16 03:19:27.356340 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-62cb14dd-39cc-407d-b8c2-6bbe2921f560 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.0713778 Nov 16 03:19:27.428384 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-ef3886f0-2a82-400c-b487-0e38b44ca749 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:27.432402 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-ef3886f0-2a82-400c-b487-0e38b44ca749 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.0664742 Nov 16 03:19:27.468986 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-9572b2ef-ffb1-47d2-999a-4212d2e91655 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:27.472241 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-9572b2ef-ffb1-47d2-999a-4212d2e91655 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.1259716 Nov 16 03:19:27.480907 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-636b57f8-5db0-4b40-bd49-794cbd5e21db service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0322289 Nov 16 03:19:27.587679 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-1979c49a-1aad-4a27-97ca-cf12c047519c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1070304 Nov 16 03:19:27.678243 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-f5fac9ff-92ee-44c4-9cd7-5b1ff75b4378 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1874430 Nov 16 03:19:27.893702 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d46dbe-4caa-4e65-8f78-6ebf8b0738af req-66afd3d5-cd6b-498d-93da-e19df29abed8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:27.904719 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e4d46dbe-4caa-4e65-8f78-6ebf8b0738af req-66afd3d5-cd6b-498d-93da-e19df29abed8 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 944 time: 0.0894763 Nov 16 03:19:27.973094 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-174563a8-7ec7-4ddc-b94d-f7dc3d390a98 service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3762946 Nov 16 03:19:27.983427 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b659f5d7-8254-4e81-890e-ed97eb35cb33 req-ea39ae85-75a9-4be4-8e68-1f43bb9c8f33 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2873781 Nov 16 03:19:28.143473 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e4d46dbe-4caa-4e65-8f78-6ebf8b0738af req-16483cef-68aa-44bd-8b86-c624f3c7ab07 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2367802 Nov 16 03:19:28.210620 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5539ad9e-0ea2-4b5b-bccb-2aad202bb5ad req-fc4ced8f-e64a-4868-bfed-671ef0efcfee service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2266383 Nov 16 03:19:28.370587 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d7cdd6-e599-42e6-8fc5-fe8f7fc2ec2f req-795df036-1757-4ab2-89ec-5851a8f61d5e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:28.384085 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13d7cdd6-e599-42e6-8fc5-fe8f7fc2ec2f req-795df036-1757-4ab2-89ec-5851a8f61d5e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1270175 Nov 16 03:19:28.466066 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3302c13-966e-468c-83af-b54f88ff753e req-9b1c28e5-d73e-4bb3-8567-f583e272a421 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:28.467786 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-9b1c28e5-d73e-4bb3-8567-f583e272a421 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 1097 time: 0.0795105 Nov 16 03:19:28.522823 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13d7cdd6-e599-42e6-8fc5-fe8f7fc2ec2f req-a00210a1-5312-4e34-aee6-08f8c12255e9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1374414 Nov 16 03:19:28.622788 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3302c13-966e-468c-83af-b54f88ff753e req-e92c681f-063b-4092-bdb0-c78861bc22c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:28.624482 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-e92c681f-063b-4092-bdb0-c78861bc22c0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 200 len: 915 time: 0.1479046 Nov 16 03:19:28.687169 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-8c109fe0-6e85-42fe-912a-2d94732ca19d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce HTTP/1.1" status: 200 len: 217 time: 0.0540628 Nov 16 03:19:28.755078 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3302c13-966e-468c-83af-b54f88ff753e req-826175b6-833c-4cc6-bddc-337e33fcd7ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:28.757724 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-826175b6-833c-4cc6-bddc-337e33fcd7ae service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 200 len: 854 time: 0.0614586 Nov 16 03:19:28.799153 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-f3e690e8-0591-456d-84eb-f7f69fea6063 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9a8436ad-09c6-4a61-8922-e3cc29d73f78&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0326142 Nov 16 03:19:28.908192 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-4ba176b6-89cb-4ff3-b8ea-90683981b55f service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900638 Nov 16 03:19:29.008147 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3302c13-966e-468c-83af-b54f88ff753e req-5734e376-ecff-419e-9541-ed63b4ea95ae service neutron] 10.222.0.11 "GET /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918951 Nov 16 03:19:29.279771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8864476d-19d2-4b5e-9047-520c9f101690 req-8d1090dc-8646-4b0a-aa16-5ef0b84c9b57 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:29.281253 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8864476d-19d2-4b5e-9047-520c9f101690 req-8d1090dc-8646-4b0a-aa16-5ef0b84c9b57 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 944 time: 0.0561681 Nov 16 03:19:29.344039 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8864476d-19d2-4b5e-9047-520c9f101690 req-e9e848f9-a072-4a19-85e0-d8e65347913f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555851 Nov 16 03:19:29.720598 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc38489-f039-4d6b-92b2-af6dd2b7cec9 req-ed80ec6f-26cb-4456-beea-9ee164ac9b3f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:29.722536 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1bc38489-f039-4d6b-92b2-af6dd2b7cec9 req-ed80ec6f-26cb-4456-beea-9ee164ac9b3f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0756958 Nov 16 03:19:29.780522 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1bc38489-f039-4d6b-92b2-af6dd2b7cec9 req-ae60ea28-7298-4cb2-86cb-e4f7c9cd0c2e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485699 Nov 16 03:19:30.474444 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1150f21-b140-496e-b440-5222761f60de req-986bc035-bfa3-41a7-a72d-b18bbe3dfaf1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:30.476252 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e1150f21-b140-496e-b440-5222761f60de req-986bc035-bfa3-41a7-a72d-b18bbe3dfaf1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 944 time: 0.0604959 Nov 16 03:19:30.535107 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e1150f21-b140-496e-b440-5222761f60de req-1f51845c-206c-4edc-b76a-9aae95b4d958 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517280 Nov 16 03:19:30.921047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa152900-93ca-4a4f-8ef5-6ede6b6d2a3a req-6073fedd-f5f5-4133-997b-52dcd1035a68 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:30.922704 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aa152900-93ca-4a4f-8ef5-6ede6b6d2a3a req-6073fedd-f5f5-4133-997b-52dcd1035a68 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0623965 Nov 16 03:19:30.964704 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:19:30.986130 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aa152900-93ca-4a4f-8ef5-6ede6b6d2a3a req-1972de93-528e-4898-a1e3-5a5c9c086a13 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564885 Nov 16 03:19:31.669216 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13a86c8-b1f3-4817-9b70-0ca82094a5d3 req-6c8a8b8f-e397-43b0-a8f6-3f0d9180a013 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:31.670904 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b13a86c8-b1f3-4817-9b70-0ca82094a5d3 req-6c8a8b8f-e397-43b0-a8f6-3f0d9180a013 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 944 time: 0.0620859 Nov 16 03:19:31.730365 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b13a86c8-b1f3-4817-9b70-0ca82094a5d3 req-167d85d1-4e91-4980-bf27-bab1ceff78a4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523686 Nov 16 03:19:32.182394 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801f1424-9eda-4d27-815a-4f0b7698dc5f req-223031f8-0c20-4d12-a1d0-13d3521782e0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:32.190077 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-801f1424-9eda-4d27-815a-4f0b7698dc5f req-223031f8-0c20-4d12-a1d0-13d3521782e0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0682101 Nov 16 03:19:32.255872 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-801f1424-9eda-4d27-815a-4f0b7698dc5f req-b7d261f2-3ee5-40e4-9d06-0066141a0a75 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644698 Nov 16 03:19:32.317284 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d415bab3-aa5f-4d8a-8710-dda8b0b824ce details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:19:32.369382 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45294) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:32.467891 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:32.490759 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce', 'network_id': '9a8436ad-09c6-4a61-8922-e3cc29d73f78', 'port_id': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce', 'mac_address': 'fa:16:3e:8c:7d:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 327, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3fb04df-83c0-4d51-afa7-1e0694c8dbc3', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:19:32.564954 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.587647 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d8d524c2-dfa8-4b94-bcb2-a7d567614e3e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.594256 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d415bab3-aa5f-4d8a-8710-dda8b0b824ce {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:19:32.623745 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:32.647167 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.710760 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d8d524c2-dfa8-4b94-bcb2-a7d567614e3e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.719735 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d8d524c2-dfa8-4b94-bcb2-a7d567614e3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.773113 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:32.781992 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.782366 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.782818 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.783249 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.783553 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.784843 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.786803 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.787464 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.791044 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.791044 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.791318 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d8d524c2-dfa8-4b94-bcb2-a7d567614e3e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ec4cb4cfc9594548a3e294dc342b8542&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4180803 Nov 16 03:19:32.791415 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.791415 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:32.791571 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8d524c2-dfa8-4b94-bcb2-a7d567614e3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04f3f8f9-3673-4459-bdc6-bc24ff47b01a,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:32.791662 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45312) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:32.884632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-27752018-0c34-4648-8ef5-2b437706fac8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.910347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-27752018-0c34-4648-8ef5-2b437706fac8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:32.988834 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f544e7-036c-47da-b9bf-f880378154c7 req-28ec3cf8-34cd-4bd0-8e6f-f55551b7debf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:32.991698 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8f544e7-036c-47da-b9bf-f880378154c7 req-28ec3cf8-34cd-4bd0-8e6f-f55551b7debf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 945 time: 0.1164198 Nov 16 03:19:33.012856 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-27752018-0c34-4648-8ef5-2b437706fac8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:33.016794 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-27752018-0c34-4648-8ef5-2b437706fac8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:33.018441 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-27752018-0c34-4648-8ef5-2b437706fac8 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/04f3f8f9-3673-4459-bdc6-bc24ff47b01a HTTP/1.1" status: 204 len: 168 time: 0.2259707 Nov 16 03:19:33.037774 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27752018-0c34-4648-8ef5-2b437706fac8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04f3f8f9-3673-4459-bdc6-bc24ff47b01a,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:33.104324 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['d415bab3-aa5f-4d8a-8710-dda8b0b824ce'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:19:33.130563 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8f544e7-036c-47da-b9bf-f880378154c7 req-f4134c96-61bb-436d-9dda-1029941c805c tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1271470 Nov 16 03:19:33.237712 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45320) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:33.438474 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529f9ea9-ab5b-4379-80a7-d582cc067ded req-e7316dc1-62df-40ba-94d5-2c29a7c911cf tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:33.446439 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-529f9ea9-ab5b-4379-80a7-d582cc067ded req-e7316dc1-62df-40ba-94d5-2c29a7c911cf tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0869393 Nov 16 03:19:33.570100 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-529f9ea9-ab5b-4379-80a7-d582cc067ded req-d1ad4c64-887e-45a1-b32c-121cef790163 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1223640 Nov 16 03:19:33.665526 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45338) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:33.695283 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-924193e8-a897-4396-9241-6c4e98fd13d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:33.793715 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d5b3b9ff-3711-4ce2-911b-ae0553fa504b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:33.912642 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-924193e8-a897-4396-9241-6c4e98fd13d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:33.925467 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-924193e8-a897-4396-9241-6c4e98fd13d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:33.971173 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d5b3b9ff-3711-4ce2-911b-ae0553fa504b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.011685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d5b3b9ff-3711-4ce2-911b-ae0553fa504b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.021928 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-924193e8-a897-4396-9241-6c4e98fd13d8 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=5bb8c5735db54f4ba6f49b7c225e7b49&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7783537 Nov 16 03:19:34.022495 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45348) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:34.024619 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924193e8-a897-4396-9241-6c4e98fd13d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=597de759-5723-4258-88c0-7b49032871cc,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:34.102895 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d5b3b9ff-3711-4ce2-911b-ae0553fa504b admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=5e6ca957daf741999d61ce3fd1099b9b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4330444 Nov 16 03:19:34.114684 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b3b9ff-3711-4ce2-911b-ae0553fa504b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33f3d1be-4a57-4d16-a03c-5379c7629b5e,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:34.114684 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45350) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:34.244685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f31af1a1-2d66-49b3-be60-ea1a63fc56ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.267085 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea4700f4-366e-4866-91ed-bab6b315ecea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.280211 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f31af1a1-2d66-49b3-be60-ea1a63fc56ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.327834 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea4700f4-366e-4866-91ed-bab6b315ecea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.339219 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d415bab3-aa5f-4d8a-8710-dda8b0b824ce up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:34.360992 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8e44c5-1987-4558-a4e0-f946bd3c3492 req-8ae6332e-5ec4-4317-b385-036a4725ede5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:34.371519 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8c8e44c5-1987-4558-a4e0-f946bd3c3492 req-8ae6332e-5ec4-4317-b385-036a4725ede5 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 945 time: 0.1258824 Nov 16 03:19:34.410494 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f31af1a1-2d66-49b3-be60-ea1a63fc56ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.416532 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f31af1a1-2d66-49b3-be60-ea1a63fc56ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.420836 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f31af1a1-2d66-49b3-be60-ea1a63fc56ca admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/597de759-5723-4258-88c0-7b49032871cc HTTP/1.1" status: 204 len: 168 time: 0.3964915 Nov 16 03:19:34.441126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8c8e44c5-1987-4558-a4e0-f946bd3c3492 req-5adf97bb-b883-4086-9fe2-4729e3a08ef9 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714109 Nov 16 03:19:34.478026 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31af1a1-2d66-49b3-be60-ea1a63fc56ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=597de759-5723-4258-88c0-7b49032871cc,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:34.484984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea4700f4-366e-4866-91ed-bab6b315ecea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.490370 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea4700f4-366e-4866-91ed-bab6b315ecea admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.494806 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ea4700f4-366e-4866-91ed-bab6b315ecea admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/33f3d1be-4a57-4d16-a03c-5379c7629b5e HTTP/1.1" status: 204 len: 168 time: 0.3755805 Nov 16 03:19:34.510905 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea4700f4-366e-4866-91ed-bab6b315ecea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33f3d1be-4a57-4d16-a03c-5379c7629b5e,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:34.511884 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port d415bab3-aa5f-4d8a-8710-dda8b0b824ce completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:19:34.518018 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port d415bab3-aa5f-4d8a-8710-dda8b0b824ce triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:34.518566 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.678463 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.726975 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:19:34.733365 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-438b02fa-2481-464b-adbf-2a0705299e04" -d '{"events": [{"server_uuid": "a955e82c-67c0-4f2f-a00d-4c784505cd9c", "name": "network-vif-plugged", "status": "completed", "tag": "d415bab3-aa5f-4d8a-8710-dda8b0b824ce"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:19:34.748016 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:34.756900 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:34.821746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa47f5a-26e6-4f7e-855b-0f8eb759d10e req-4d3bdcd9-296c-4ac9-88a1-06269358560c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:34.830422 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:19:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7b2f0da-2e1c-47fd-a914-f29c030e8994 x-openstack-request-id: req-d7b2f0da-2e1c-47fd-a914-f29c030e8994 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:19:34.830736 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a955e82c-67c0-4f2f-a00d-4c784505cd9c", "name": "network-vif-plugged", "status": "completed", "tag": "d415bab3-aa5f-4d8a-8710-dda8b0b824ce", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:19:34.830985 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-d7b2f0da-2e1c-47fd-a914-f29c030e8994 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:19:34.831356 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fa47f5a-26e6-4f7e-855b-0f8eb759d10e req-4d3bdcd9-296c-4ac9-88a1-06269358560c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1189802 Nov 16 03:19:34.831483 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce', 'code': 200} Nov 16 03:19:34.851992 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45380) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:34.888668 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:34.923238 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fa47f5a-26e6-4f7e-855b-0f8eb759d10e req-2bcac5b4-ff47-4152-99b7-4393bdc83861 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864005 Nov 16 03:19:35.091366 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb9c2ac0-d4cb-4b3f-a6bf-070963bf7e82 req-fc5ec2b4-9581-4464-bb34-c60867064b2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:35.092885 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb9c2ac0-d4cb-4b3f-a6bf-070963bf7e82 req-fc5ec2b4-9581-4464-bb34-c60867064b2f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 1099 time: 0.0728886 Nov 16 03:19:35.123594 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45386) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:35.143694 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2dee43fc-e926-4de6-84ea-e73ac1229fd0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.182201 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb9c2ac0-d4cb-4b3f-a6bf-070963bf7e82 req-2b870c17-2d9b-4d59-ab64-0831085c9ff6 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801055 Nov 16 03:19:35.330747 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2dee43fc-e926-4de6-84ea-e73ac1229fd0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.338307 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2dee43fc-e926-4de6-84ea-e73ac1229fd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.403563 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45390) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:35.404089 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2dee43fc-e926-4de6-84ea-e73ac1229fd0 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=479c1573f4974a1aa44edba3757ca7a3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2782750 Nov 16 03:19:35.405579 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dee43fc-e926-4de6-84ea-e73ac1229fd0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6119ff9-d549-4574-bb86-7521c77a12a0,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:35.456743 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1347472510-network', 'tenant_id': 'f0e656658949487fb898565d34636908'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:35.508579 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Made reservation on behalf of f0e656658949487fb898565d34636908 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:19:35.511831 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.523315 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.609116 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01b505e3-cb09-42ee-9f16-d55fb0e28707 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.686262 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.694619 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.700634 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01b505e3-cb09-42ee-9f16-d55fb0e28707 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.731619 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ead3994-36fd-4925-bcda-d3ee108b61ff req-a18d432b-74d7-4f8e-9c9d-cf7e43c7b718 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:35.733371 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ead3994-36fd-4925-bcda-d3ee108b61ff req-a18d432b-74d7-4f8e-9c9d-cf7e43c7b718 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 946 time: 0.1497350 Nov 16 03:19:35.748312 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 304} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:19:35.781533 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.784742 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.785625 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Added segment b3df5703-5784-41a7-b817-6be11be04ba5 of type vlan for network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 Nov 16 03:19:35.867526 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ead3994-36fd-4925-bcda-d3ee108b61ff req-df763015-8863-4504-a78c-5104ce36d0db tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1256437 Nov 16 03:19:35.872368 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d1645fc-b210-4a09-bd1b-799defa19491,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:35.899796 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.901646 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01b505e3-cb09-42ee-9f16-d55fb0e28707 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.907328 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01b505e3-cb09-42ee-9f16-d55fb0e28707 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.915447 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-01b505e3-cb09-42ee-9f16-d55fb0e28707 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c6119ff9-d549-4574-bb86-7521c77a12a0 HTTP/1.1" status: 204 len: 168 time: 0.5092466 Nov 16 03:19:35.935655 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b505e3-cb09-42ee-9f16-d55fb0e28707 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6119ff9-d549-4574-bb86-7521c77a12a0,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:35.976686 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:35.980292 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:35.981615 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:36.119270 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.2649293 Nov 16 03:19:36.125243 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45414) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:36.129874 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce538d9-4982-4937-a892-1134d9f2f900 admin admin] Pushing event updated for resources: {'Network': ['ID=47ea8a48-7e03-48bf-883e-ab437cbcd3a0,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:36.134739 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Request body: {'subnet': {'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1347472510-subnet', 'tenant_id': 'f0e656658949487fb898565d34636908', 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:36.145549 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:19:36.328356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Made reservation on behalf of f0e656658949487fb898565d34636908 for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:19:36.331038 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:36.360555 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e69dfa1-b8a1-44f5-926b-44a494f7f3ff req-54036d30-6faa-4a16-b1cf-cbad1040eef0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:36.372353 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e69dfa1-b8a1-44f5-926b-44a494f7f3ff req-54036d30-6faa-4a16-b1cf-cbad1040eef0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1882331 Nov 16 03:19:36.622912 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e69dfa1-b8a1-44f5-926b-44a494f7f3ff req-f3e12df2-4ae1-48eb-a8b0-4dd7d9b48663 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2481234 Nov 16 03:19:36.718660 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45428) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:36.734137 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1a5e97f5-c9bd-44c9-b56d-7890c4800f89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:36.794421 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:36.890112 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Pushing event updated for resources: {'Subnet': ['ID=5adb8701-919b-407f-b696-94dbe3d5e70a,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:36.890390 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1a5e97f5-c9bd-44c9-b56d-7890c4800f89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:36.902704 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1a5e97f5-c9bd-44c9-b56d-7890c4800f89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:36.948833 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Checking segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:36.948833 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Network hostable DHCP agents. Network: 47ea8a48-7e03-48bf-883e-ab437cbcd3a0, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:19:36.980635 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:19:36.998815 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 47ea8a48-7e03-48bf-883e-ab437cbcd3a0) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:37.011371 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-568a469f-2996-43dd-b3a5-d84c2ec1cdb8 None None] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:19:37.016243 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1a5e97f5-c9bd-44c9-b56d-7890c4800f89 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=c98fbfa10a2c44b3a7b9c48a7cd15540&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2962415 Nov 16 03:19:37.018747 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:37.019538 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45432) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:37.020719 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.031612 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5e97f5-c9bd-44c9-b56d-7890c4800f89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c182b5b4-1c02-4c3a-b1db-9a9053bca9ad,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:37.069711 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-af171988-7553-4d28-9049-f0ca69e5b65d admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.9419513 Nov 16 03:19:37.070720 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45434) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:37.091075 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:37.175502 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dfcb156d-918f-4820-9237-aba553fda0ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.220907 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.233022 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.233539 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dfcb156d-918f-4820-9237-aba553fda0ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.277491 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15b7a62-2400-4225-b857-f10d34d48a4e req-4ef75154-7a09-4018-bca9-d1151d9c8a08 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:37.281521 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b15b7a62-2400-4225-b857-f10d34d48a4e req-4ef75154-7a09-4018-bca9-d1151d9c8a08 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 946 time: 0.1632969 Nov 16 03:19:37.334449 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:19:37.336781 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.337555 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dfcb156d-918f-4820-9237-aba553fda0ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.340479 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-dfcb156d-918f-4820-9237-aba553fda0ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.341743 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-dfcb156d-918f-4820-9237-aba553fda0ed admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c182b5b4-1c02-4c3a-b1db-9a9053bca9ad HTTP/1.1" status: 204 len: 168 time: 0.3185198 Nov 16 03:19:37.351732 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcb156d-918f-4820-9237-aba553fda0ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c182b5b4-1c02-4c3a-b1db-9a9053bca9ad,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:37.461212 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b15b7a62-2400-4225-b857-f10d34d48a4e req-672f9a4e-8ad5-4cdf-b059-8d16dc25be23 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1572995 Nov 16 03:19:37.463149 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.539976 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Allocated IP 172.20.0.2 (47ea8a48-7e03-48bf-883e-ab437cbcd3a0/5adb8701-919b-407f-b696-94dbe3d5e70a/75ee9abc-3389-4b4e-b64f-0161820cde17) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:37.689331 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.791664 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.803804 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.858659 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:37.864452 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:37.869364 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:37.907193 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Pushing event updated for resources: {'Port': ['ID=75ee9abc-3389-4b4e-b64f-0161820cde17,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:37.974118 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Attempting to bind port 75ee9abc-3389-4b4e-b64f-0161820cde17 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:37.974482 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Attempting to bind port 75ee9abc-3389-4b4e-b64f-0161820cde17 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:37.977517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Attempting to bind port 75ee9abc-3389-4b4e-b64f-0161820cde17 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:37.994647 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:37.995010 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Checking segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:37.995588 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:37.996148 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Bound using segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:37.996811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Bound port: 75ee9abc-3389-4b4e-b64f-0161820cde17, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:37.997368 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:38.064598 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89de0980-92c5-4774-8531-decae9755742 req-4762e76f-4c51-4291-b20d-ae3963b02cfe tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:38.068389 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89de0980-92c5-4774-8531-decae9755742 req-4762e76f-4c51-4291-b20d-ae3963b02cfe tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2388897 Nov 16 03:19:38.149112 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] For port 75ee9abc-3389-4b4e-b64f-0161820cde17, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:38.153924 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] For port 75ee9abc-3389-4b4e-b64f-0161820cde17, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=75ee9abc-3389-4b4e-b64f-0161820cde17,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:38.161481 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:38.206028 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89de0980-92c5-4774-8531-decae9755742 req-fc2e54b4-0b20-472d-8e46-1d5276cd2dab tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159577 Nov 16 03:19:38.266627 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:38.290527 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d724a76e-f77e-4256-9bda-62a7e4bfd79f None None] Pushing event updated for resources: {'Port': ['ID=75ee9abc-3389-4b4e-b64f-0161820cde17,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:38.307838 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:38.586239 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Allocated IP 172.27.1.231 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/5c47b562-7710-4bbb-b511-1e0092b0cf5e) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:38.880876 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:38.929705 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:38.999087 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:39.005194 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:39.008936 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Pushing event updated for resources: {'Port': ['ID=5c47b562-7710-4bbb-b511-1e0092b0cf5e,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:39.012698 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:39.758632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75bf33b3-4f23-4af7-bfe0-3f1062e6bd53 req-afa76efa-f475-4de5-a757-1ec98c935dc5 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:39.769150 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-75bf33b3-4f23-4af7-bfe0-3f1062e6bd53 req-afa76efa-f475-4de5-a757-1ec98c935dc5 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1662397 Nov 16 03:19:39.770718 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3208ead-859d-4ace-87e6-1e0e6e34c91e None None] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:19:39.959953 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.122810 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-74028120-05b5-44a7-8e71-3ca5fdf10e7e None None] Provisioning complete for port 75ee9abc-3389-4b4e-b64f-0161820cde17 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:40.125862 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-74028120-05b5-44a7-8e71-3ca5fdf10e7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.272783 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-75bf33b3-4f23-4af7-bfe0-3f1062e6bd53 req-b4860dc3-84da-46ca-b8ae-ee08e47887b9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5024920 Nov 16 03:19:40.315347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.328118 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-74028120-05b5-44a7-8e71-3ca5fdf10e7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.402431 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-74028120-05b5-44a7-8e71-3ca5fdf10e7e None None] For port 75ee9abc-3389-4b4e-b64f-0161820cde17, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=75ee9abc-3389-4b4e-b64f-0161820cde17,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:40.411527 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-74028120-05b5-44a7-8e71-3ca5fdf10e7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.493606 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74028120-05b5-44a7-8e71-3ca5fdf10e7e None None] Pushing event updated for resources: {'Port': ['ID=75ee9abc-3389-4b4e-b64f-0161820cde17,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:40.514738 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101899) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:19:40.535753 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 75ee9abc-3389-4b4e-b64f-0161820cde17 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:40.597793 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 75ee9abc-3389-4b4e-b64f-0161820cde17 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:40.598542 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.649993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:19:40.653774 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-908a0860-3fc1-4dc6-80fc-4fa946a6cec3 None None] Provisioning complete for port 75ee9abc-3389-4b4e-b64f-0161820cde17 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:40.654748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-908a0860-3fc1-4dc6-80fc-4fa946a6cec3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.660221 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:19:40.668794 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:40.670570 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:40.671135 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:40.672939 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45512) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:40.673510 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-6afcfc24-e389-415f-9c40-fad6af77c33e admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.5938962 Nov 16 03:19:40.827939 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:41.028990 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:39Z', 'revision_number': 3, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:41.064009 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:19:41.064242 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Updating router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c port 5c47b562-7710-4bbb-b511-1e0092b0cf5e binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:19:41.088905 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.162483 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.384623 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Allocated IP 172.20.0.1 (47ea8a48-7e03-48bf-883e-ab437cbcd3a0/5adb8701-919b-407f-b696-94dbe3d5e70a/78dd7ed6-d615-48fd-9062-5608943ec7cc) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:41.396225 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.404966 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.423789 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98d57d4-5d09-463d-a5ee-5baabb1cfa62 req-7eab1702-7c23-4f6a-8ded-b49c0d18944f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:41.426677 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a98d57d4-5d09-463d-a5ee-5baabb1cfa62 req-7eab1702-7c23-4f6a-8ded-b49c0d18944f tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0743451 Nov 16 03:19:41.451799 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Pushing event updated for resources: {'Port': ['ID=5c47b562-7710-4bbb-b511-1e0092b0cf5e,revision_number=2']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:41.460330 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.460963 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.461491 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.461965 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.462441 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.462922 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.463250 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.463571 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.463907 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.464226 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.464551 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.464859 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:19:41.498186 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a98d57d4-5d09-463d-a5ee-5baabb1cfa62 req-bc36d893-c4e3-4841-a916-63cec8ef751b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650859 Nov 16 03:19:41.519479 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Attempting to bind port 5c47b562-7710-4bbb-b511-1e0092b0cf5e on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:41.520339 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Attempting to bind port 5c47b562-7710-4bbb-b511-1e0092b0cf5e by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:41.521505 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Attempting to bind port 5c47b562-7710-4bbb-b511-1e0092b0cf5e on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:41.528471 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:41.529037 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:41.529557 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.530008 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:41.530539 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Bound port: 5c47b562-7710-4bbb-b511-1e0092b0cf5e, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:41.531145 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.533330 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.612992 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] For port 5c47b562-7710-4bbb-b511-1e0092b0cf5e, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:41.617089 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] For port 5c47b562-7710-4bbb-b511-1e0092b0cf5e, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=5c47b562-7710-4bbb-b511-1e0092b0cf5e,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:41.632096 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.707015 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a9d0ea-ae32-48c4-af6f-1e4b0de81673 None None] Pushing event updated for resources: {'Port': ['ID=5c47b562-7710-4bbb-b511-1e0092b0cf5e,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:41.710180 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:41.710797 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:41.774410 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:41.835623 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:41.858060 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:41.860800 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:41.873694 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Pushing event updated for resources: {'Port': ['ID=78dd7ed6-d615-48fd-9062-5608943ec7cc,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:41.878568 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:41.996026 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:42.187720 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:39Z', 'revision_number': 3, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:42.249051 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c425e745-6d55-4fc5-abd0-d97fbc392aae None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:39Z', 'revision_number': 3, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:19:42.270537 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-ea667c7c-7446-4359-9c14-250046cc589f None None] Provisioning complete for port 78dd7ed6-d615-48fd-9062-5608943ec7cc triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:42.271742 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ea667c7c-7446-4359-9c14-250046cc589f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:42.406916 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-ea667c7c-7446-4359-9c14-250046cc589f None None] Port 78dd7ed6-d615-48fd-9062-5608943ec7cc cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:19:42.523088 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:42.554524 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 75ee9abc-3389-4b4e-b64f-0161820cde17 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:42.621971 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 75ee9abc-3389-4b4e-b64f-0161820cde17 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:42.622832 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:42.857265 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382c21a8-5ac6-45ea-8803-b9ca083352ea req-77b87c5c-e497-40a4-9e93-7cfefc956402 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:42.859097 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-382c21a8-5ac6-45ea-8803-b9ca083352ea req-77b87c5c-e497-40a4-9e93-7cfefc956402 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2533677 Nov 16 03:19:42.962453 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-382c21a8-5ac6-45ea-8803-b9ca083352ea req-dea29ad0-437d-4bdd-b0ae-d5c4ed51f4b0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921781 Nov 16 03:19:42.999321 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:43.007374 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:43.103231 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Pushing event updated for resources: {'Port': ['ID=78dd7ed6-d615-48fd-9062-5608943ec7cc,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:43.116440 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:43.301789 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:43.303298 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:43.576364 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:19:43.655923 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8237d9f5-a042-48ab-96a9-5a30f5fe0f42 None None] Provisioning complete for port 78dd7ed6-d615-48fd-9062-5608943ec7cc triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:43.656620 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8237d9f5-a042-48ab-96a9-5a30f5fe0f42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:43.735117 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8237d9f5-a042-48ab-96a9-5a30f5fe0f42 None None] Port 78dd7ed6-d615-48fd-9062-5608943ec7cc cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:19:43.783390 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:19:43.806550 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b1324e29-4299-49cc-b864-ce239bd7de55 admin admin] 10.222.0.31 "PUT /v2.0/routers/2f54eadc-59f5-4dd8-820b-7d52e3f81a9c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1314456 Nov 16 03:19:44.155009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ad1f38-dd66-400b-9a4d-f3e04398c3fb req-58b12fd9-51a4-4ef7-8d58-206d01f42902 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:44.156575 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-12ad1f38-dd66-400b-9a4d-f3e04398c3fb req-58b12fd9-51a4-4ef7-8d58-206d01f42902 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0596945 Nov 16 03:19:44.217348 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-12ad1f38-dd66-400b-9a4d-f3e04398c3fb req-c3c11e94-fa3b-4759-96ac-6a3dfc47f5e8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521586 Nov 16 03:19:44.372288 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-86bd73b1-e3df-4934-93f0-3abf80ef56a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.467625 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 5c47b562-7710-4bbb-b511-1e0092b0cf5e up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:44.532254 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 5c47b562-7710-4bbb-b511-1e0092b0cf5e triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:44.532622 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.564526 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45586) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:44.573753 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1991510355-network', 'tenant_id': 'f616d231885846a299f65758235aaa76'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:44.621119 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Made reservation on behalf of f616d231885846a299f65758235aaa76 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:19:44.624295 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.636750 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.678025 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.709378 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 5c47b562-7710-4bbb-b511-1e0092b0cf5e, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=5c47b562-7710-4bbb-b511-1e0092b0cf5e,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:44.716132 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.758999 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.762280 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.797689 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=5c47b562-7710-4bbb-b511-1e0092b0cf5e,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:44.806767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 335} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:19:44.821500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b861dd2-5a05-4003-bea4-240afec8d0fc,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:44.836050 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.836050 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Added segment f08d8d97-7a2b-4489-bc72-282380d6b63a of type vlan for network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 Nov 16 03:19:44.840213 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:19:44.853719 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:44.854318 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:44.888445 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.922445 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.923426 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:44.923999 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:44.978016 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:44.994081 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4252367 Nov 16 03:19:44.994586 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45596) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:45.004139 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Request body: {'subnet': {'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1991510355-subnet', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:45.012350 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad487737-de83-451b-a807-d81eccca36d2 admin admin] Pushing event updated for resources: {'Network': ['ID=b1af4650-1ff7-4f03-957a-4c5c8ba142c1,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:45.025625 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:19:45.040433 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Made reservation on behalf of f616d231885846a299f65758235aaa76 for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:19:45.043018 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.252001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.288604 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 2, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:45.320095 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:19:45.320470 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Updating router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c port 78dd7ed6-d615-48fd-9062-5608943ec7cc binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:19:45.325933 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Pushing event updated for resources: {'Subnet': ['ID=7546ff7f-8540-45b0-b867-f6a1fceb9e4c,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:45.358457 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.358593 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Checking segment: {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:45.359378 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Network hostable DHCP agents. Network: b1af4650-1ff7-4f03-957a-4c5c8ba142c1, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:19:45.391950 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:19:45.420963 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c83ec7-603e-439f-ad0f-3b85a836cc5a req-1694c8ff-5c0e-4237-bd1c-fddaa0d9c2cd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:45.422583 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b8c83ec7-603e-439f-ad0f-3b85a836cc5a req-1694c8ff-5c0e-4237-bd1c-fddaa0d9c2cd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1161892 Nov 16 03:19:45.431865 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, b1af4650-1ff7-4f03-957a-4c5c8ba142c1) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:45.445238 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:45.446473 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.478618 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06e1cae4-dd7d-4367-8013-7effbeaff747 None None] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:19:45.496564 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-2167a9fa-b150-459e-8263-1ebc0ddae17a admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5003915 Nov 16 03:19:45.500569 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45602) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:45.508178 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:45.532738 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b8c83ec7-603e-439f-ad0f-3b85a836cc5a req-aa3560d7-d89a-4890-a0a2-066c90c43029 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909669 Nov 16 03:19:45.540638 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.541881 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.612244 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.792191 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:45.970951 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-b1af4650-1ff7-4f03-957a-4c5c8ba142c1', 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'fixed_ips': [{'subnet_id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:19:45.971825 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.013036 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.069007 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.095474 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.117651 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.179485 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2aef20-24ab-458a-96f9-0bba7e98618a None None] Pushing event updated for resources: {'Port': ['ID=78dd7ed6-d615-48fd-9062-5608943ec7cc,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:46.244363 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Allocated IP 172.27.1.41 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/90b8edf2-7453-412e-9292-0ff80b7cd3e1) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:46.247888 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Allocated IP 172.20.0.2 (b1af4650-1ff7-4f03-957a-4c5c8ba142c1/7546ff7f-8540-45b0-b867-f6a1fceb9e4c/4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:46.268079 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Attempting to bind port 78dd7ed6-d615-48fd-9062-5608943ec7cc on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:46.268452 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Attempting to bind port 78dd7ed6-d615-48fd-9062-5608943ec7cc by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:46.268811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Attempting to bind port 78dd7ed6-d615-48fd-9062-5608943ec7cc on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:46.281387 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:46.281940 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Checking segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:46.282464 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.282986 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Bound using segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:46.283489 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Bound port: 78dd7ed6-d615-48fd-9062-5608943ec7cc, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:46.284237 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.399405 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.465463 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.468039 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 5c47b562-7710-4bbb-b511-1e0092b0cf5e up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:46.524410 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:46.525769 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:46.532282 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:46.541312 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] For port 78dd7ed6-d615-48fd-9062-5608943ec7cc, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:46.559831 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Pushing event updated for resources: {'Port': ['ID=90b8edf2-7453-412e-9292-0ff80b7cd3e1,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:46.564296 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] For port 78dd7ed6-d615-48fd-9062-5608943ec7cc, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=78dd7ed6-d615-48fd-9062-5608943ec7cc,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:46.585938 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-985971ac-1742-4f23-8e5c-8bc87400f215 None None] Provisioning complete for port 78dd7ed6-d615-48fd-9062-5608943ec7cc triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:46.586282 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-985971ac-1742-4f23-8e5c-8bc87400f215 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.589939 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.671060 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.692001 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:46.695750 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:46.843759 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1133a664-25c6-4bc3-b273-3c2a4c056534 req-fd9041c1-f18a-40bc-ac1b-2be1ebcab798 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:46.859322 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1133a664-25c6-4bc3-b273-3c2a4c056534 req-fd9041c1-f18a-40bc-ac1b-2be1ebcab798 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2274222 Nov 16 03:19:46.905532 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:46.905783 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:46.936307 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1133a664-25c6-4bc3-b273-3c2a4c056534 req-d06e0e0b-ba68-4317-b5e1-556ca38bdf34 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756330 Nov 16 03:19:47.064122 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:47.148676 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:47.174488 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:47.180139 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:47.288444 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:47.318474 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 5c47b562-7710-4bbb-b511-1e0092b0cf5e triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:47.319133 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:47.320969 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2aef20-24ab-458a-96f9-0bba7e98618a None None] Pushing event updated for resources: {'Port': ['ID=78dd7ed6-d615-48fd-9062-5608943ec7cc,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:47.557139 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Attempting to bind port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:47.561854 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Attempting to bind port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:47.562516 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Attempting to bind port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 on network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:47.604679 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Pushing event updated for resources: {'Port': ['ID=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:47.721786 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:47.724313 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Checking segment: {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:47.731138 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:47.734481 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Bound using segment: {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:47.739868 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Bound port: 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:47.742176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:47.806020 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-985971ac-1742-4f23-8e5c-8bc87400f215 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:48.043211 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-985971ac-1742-4f23-8e5c-8bc87400f215 None None] For port 78dd7ed6-d615-48fd-9062-5608943ec7cc, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=78dd7ed6-d615-48fd-9062-5608943ec7cc,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:48.056920 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-985971ac-1742-4f23-8e5c-8bc87400f215 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:48.176889 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:46Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:48.229941 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c424a8c-d138-4a31-af8d-5d49cff9cd22 None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:46Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:19:48.248331 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] For port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:48.286908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Router 4df3e9d8-80be-4b7b-8046-27014c1ff987 is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101898) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:19:48.288057 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-745e1817-2c44-48aa-bf0a-d596467b1b6c None None] Provisioning complete for port 78dd7ed6-d615-48fd-9062-5608943ec7cc triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:48.288057 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-745e1817-2c44-48aa-bf0a-d596467b1b6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:48.292248 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] For port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,segment=NetworkSegment(f08d8d97-7a2b-4489-bc72-282380d6b63a),segment_id=f08d8d97-7a2b-4489-bc72-282380d6b63a)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:48.296947 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-985971ac-1742-4f23-8e5c-8bc87400f215 None None] Pushing event updated for resources: {'Port': ['ID=78dd7ed6-d615-48fd-9062-5608943ec7cc,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:48.358549 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:48.421096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c900cac-bb60-472b-bd98-f7f205a08125 req-7c0a8dbd-1015-4f25-a23d-a039f4276fba tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:48.429060 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2c900cac-bb60-472b-bd98-f7f205a08125 req-7c0a8dbd-1015-4f25-a23d-a039f4276fba tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2001688 Nov 16 03:19:48.689363 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 78dd7ed6-d615-48fd-9062-5608943ec7cc up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:48.699798 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2c900cac-bb60-472b-bd98-f7f205a08125 req-44f550b3-5a55-4ab2-97a5-d8a534b17423 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2693233 Nov 16 03:19:48.766244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d45e97-b5cc-437c-9f04-ebbf0465fef8 None None] Pushing event updated for resources: {'Port': ['ID=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:48.782709 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c3c55e3c-96aa-445d-aab0-4bcecee11da9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:48.791770 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:19:48.820649 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Sync routers for ids ['4df3e9d8-80be-4b7b-8046-27014c1ff987'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:19:48.824203 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:48.830211 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-835c778e-ee01-4bac-9130-599a67198122 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.3273554 Nov 16 03:19:48.830755 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45652) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:48.851604 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Routers {'4df3e9d8-80be-4b7b-8046-27014c1ff987'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:48.852250 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['4df3e9d8-80be-4b7b-8046-27014c1ff987'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:49.195207 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Set router 4df3e9d8-80be-4b7b-8046-27014c1ff987 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:49.351244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 78dd7ed6-d615-48fd-9062-5608943ec7cc triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:49.351980 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:49.576437 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:19:46Z', 'revision_number': 3, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:49.608910 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Checking router: 4df3e9d8-80be-4b7b-8046-27014c1ff987 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:19:49.609251 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Updating router 4df3e9d8-80be-4b7b-8046-27014c1ff987 port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:19:49.637291 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:49.746430 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:49.771459 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.021998 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.032519 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.089745 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Attempting to bind port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:50.090103 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Attempting to bind port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:50.090639 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Attempting to bind port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:50.104523 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:50.105397 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:50.106000 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.106551 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:50.107202 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Bound port: 90b8edf2-7453-412e-9292-0ff80b7cd3e1, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:50.107779 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.138375 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e3336c3-1577-4daa-9e0a-ce1d921bca13 None None] Pushing event updated for resources: {'Port': ['ID=90b8edf2-7453-412e-9292-0ff80b7cd3e1,revision_number=2']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:50.148529 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Allocated IP 172.20.0.1 (b1af4650-1ff7-4f03-957a-4c5c8ba142c1/7546ff7f-8540-45b0-b867-f6a1fceb9e4c/a0899499-351a-4f08-8b71-8a19ab6cda2b) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:19:50.188891 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] For port 90b8edf2-7453-412e-9292-0ff80b7cd3e1, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:50.193857 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] For port 90b8edf2-7453-412e-9292-0ff80b7cd3e1, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=90b8edf2-7453-412e-9292-0ff80b7cd3e1,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:50.203240 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.273060 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46f3f8b-1704-41d9-a647-cb979987feda req-b94b8aa2-a111-48be-a20f-878718b76165 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:50.278681 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Routers {'4df3e9d8-80be-4b7b-8046-27014c1ff987'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:50.279334 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['4df3e9d8-80be-4b7b-8046-27014c1ff987'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:50.281048 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81319246-aba9-4c4a-a882-8408e461d982 None None] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:19:50.285934 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e3336c3-1577-4daa-9e0a-ce1d921bca13 None None] Pushing event updated for resources: {'Port': ['ID=90b8edf2-7453-412e-9292-0ff80b7cd3e1,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:50.286239 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b46f3f8b-1704-41d9-a647-cb979987feda req-b94b8aa2-a111-48be-a20f-878718b76165 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.3955810 Nov 16 03:19:50.408208 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8b980538-4b2a-4429-9071-9d537adfd6c0 None None] Provisioning complete for port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:50.409469 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8b980538-4b2a-4429-9071-9d537adfd6c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.421807 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.434550 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] Set router 4df3e9d8-80be-4b7b-8046-27014c1ff987 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:50.474436 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b46f3f8b-1704-41d9-a647-cb979987feda req-01ce9fa6-f686-4307-8571-7a34d7748f6e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1871064 Nov 16 03:19:50.481171 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.541365 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:50.544770 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:50.549356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:19:50.553340 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Pushing event updated for resources: {'Port': ['ID=a0899499-351a-4f08-8b71-8a19ab6cda2b,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:50.602657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.619336 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:50.687583 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:19:46Z', 'revision_number': 3, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:50.699171 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8b980538-4b2a-4429-9071-9d537adfd6c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.753833 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0d7d0d-2059-463c-bc42-35a78830f4b7 None None] The sync data for ids ['4df3e9d8-80be-4b7b-8046-27014c1ff987'] in dv-cinder-818037-1-iscsi is: [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:19:46Z', 'revision_number': 3, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:19:50.759602 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:50.761074 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.766316 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8b980538-4b2a-4429-9071-9d537adfd6c0 None None] For port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,segment=NetworkSegment(f08d8d97-7a2b-4489-bc72-282380d6b63a),segment_id=f08d8d97-7a2b-4489-bc72-282380d6b63a)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:50.790657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.795378 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8b980538-4b2a-4429-9071-9d537adfd6c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:50.880335 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b980538-4b2a-4429-9071-9d537adfd6c0 None None] Pushing event updated for resources: {'Port': ['ID=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:51.028822 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-4e97eddf-3258-43f4-98ff-d74a5b351bfe None None] Provisioning complete for port a0899499-351a-4f08-8b71-8a19ab6cda2b triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:51.029205 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4e97eddf-3258-43f4-98ff-d74a5b351bfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.078919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.095704 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.115912 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-4e97eddf-3258-43f4-98ff-d74a5b351bfe None None] Port a0899499-351a-4f08-8b71-8a19ab6cda2b cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:19:51.167808 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-4e97eddf-3258-43f4-98ff-d74a5b351bfe None None] Provisioning complete for port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:51.168351 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4e97eddf-3258-43f4-98ff-d74a5b351bfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.288040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.452668 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Pushing event updated for resources: {'Port': ['ID=a0899499-351a-4f08-8b71-8a19ab6cda2b,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:51.622460 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.655980 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:19:51.665812 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:19:51.731931 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.764295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-17c3fba0-1b62-4e96-a7b3-bdf5418543a5 None None] Provisioning complete for port a0899499-351a-4f08-8b71-8a19ab6cda2b triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:51.764948 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-17c3fba0-1b62-4e96-a7b3-bdf5418543a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:51.917533 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-17c3fba0-1b62-4e96-a7b3-bdf5418543a5 None None] Port a0899499-351a-4f08-8b71-8a19ab6cda2b cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:19:52.319467 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-2e9fbfce-87e2-4b7f-855f-8cd30f804d25 None None] Provisioning complete for port a0899499-351a-4f08-8b71-8a19ab6cda2b triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:52.320313 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2e9fbfce-87e2-4b7f-855f-8cd30f804d25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:52.421510 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-2e9fbfce-87e2-4b7f-855f-8cd30f804d25 None None] Port a0899499-351a-4f08-8b71-8a19ab6cda2b cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:19:52.609889 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f2c6a9-036f-4bb5-a2b2-c4cc40d32147 req-58aa969f-ef82-451e-97a7-ebbca7effedd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:52.611679 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-32f2c6a9-036f-4bb5-a2b2-c4cc40d32147 req-58aa969f-ef82-451e-97a7-ebbca7effedd tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.7647793 Nov 16 03:19:52.784446 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 90b8edf2-7453-412e-9292-0ff80b7cd3e1 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:52.790098 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Router 4df3e9d8-80be-4b7b-8046-27014c1ff987 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:19:52.810508 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-32f2c6a9-036f-4bb5-a2b2-c4cc40d32147 req-f43711c8-f7c8-4890-9977-20c79e97a0b1 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792159 Nov 16 03:19:52.918913 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962daa13-3bbe-4241-bb68-1d5852d514ee req-b53f519a-f29a-4529-af26-f268adf03a26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:52.918913 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-962daa13-3bbe-4241-bb68-1d5852d514ee req-b53f519a-f29a-4529-af26-f268adf03a26 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.2186246 Nov 16 03:19:52.947777 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:52.950340 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:53.008137 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:19:53.040751 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a11eca77-a41d-4886-865a-b67349d83749 admin admin] 10.222.0.31 "PUT /v2.0/routers/4df3e9d8-80be-4b7b-8046-27014c1ff987/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2084134 Nov 16 03:19:53.096493 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-962daa13-3bbe-4241-bb68-1d5852d514ee req-db1f47ca-0bdc-4fb0-b78f-134e010539ac service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1653206 Nov 16 03:19:53.177092 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:53.217692 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 90b8edf2-7453-412e-9292-0ff80b7cd3e1, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=90b8edf2-7453-412e-9292-0ff80b7cd3e1,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:53.224591 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:53.229511 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:53.371135 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:53.371926 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:53.538795 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=90b8edf2-7453-412e-9292-0ff80b7cd3e1,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:54.013063 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Sync routers for ids ['4df3e9d8-80be-4b7b-8046-27014c1ff987'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:19:54.058170 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Routers {'4df3e9d8-80be-4b7b-8046-27014c1ff987'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:54.061135 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['4df3e9d8-80be-4b7b-8046-27014c1ff987'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:54.186771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be15f02a-73ca-4078-a9e9-31688b7e98ef req-45b57be1-5906-4a6c-ac83-3d8c0df8fca8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:54.188732 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-be15f02a-73ca-4078-a9e9-31688b7e98ef req-45b57be1-5906-4a6c-ac83-3d8c0df8fca8 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2060678 Nov 16 03:19:54.360234 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-be15f02a-73ca-4078-a9e9-31688b7e98ef req-92c3b9b1-e08c-409a-be98-bb133235c267 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1597519 Nov 16 03:19:54.468597 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Set router 4df3e9d8-80be-4b7b-8046-27014c1ff987 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:54.568608 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 90b8edf2-7453-412e-9292-0ff80b7cd3e1 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:19:54.647989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45806) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:54.656552 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1557299526', 'description': 'tempest-secgroup-smoke-1557299526 description', 'project_id': 'f0e656658949487fb898565d34636908'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:54.760669 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:54.912953 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:54.913268 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.074604 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.083623 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.110270 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:19:50Z', 'revision_number': 4, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': 'a0899499-351a-4f08-8b71-8a19ab6cda2b', 'name': '', 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'mac_address': 'fa:16:3e:f3:ca:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_interface', 'standard_attr_id': 435, 'fixed_ips': [{'subnet_id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:49Z', 'updated_at': '2021-11-16T03:19:50Z', 'revision_number': 2, 'project_id': 'f616d231885846a299f65758235aaa76', 'subnets': [{'id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:55.169047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.170978 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.5211146 Nov 16 03:19:55.173876 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45816) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:55.176649 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Checking router: 4df3e9d8-80be-4b7b-8046-27014c1ff987 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:19:55.177221 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Updating router 4df3e9d8-80be-4b7b-8046-27014c1ff987 port a0899499-351a-4f08-8b71-8a19ab6cda2b binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:19:55.180065 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8317d9bd-65d6-4f8e-9372-6278e18b60d4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b3b2cefa-a732-4c2d-8879-25a8537d518a,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:55.194982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group_rule': {'security_group_id': 'b3b2cefa-a732-4c2d-8879-25a8537d518a', 'project_id': 'f0e656658949487fb898565d34636908', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:55.289334 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.428155 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.505563 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.512413 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.584368 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d52f2bd9-27ea-4bf7-a196-f6deac9220a5,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:55.589688 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.591335 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4a3b4ec3-514b-4ae7-bed7-c10568b4d315 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4126577 Nov 16 03:19:55.595203 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45834) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:55.601276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group_rule': {'security_group_id': 'b3b2cefa-a732-4c2d-8879-25a8537d518a', 'project_id': 'f0e656658949487fb898565d34636908', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:55.645908 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.744563 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee37d04-696d-4537-99bd-ff47ca674be3 req-9841a0c7-9c01-49fd-8399-cc0bf7b37e76 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:55.744563 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ee37d04-696d-4537-99bd-ff47ca674be3 req-9841a0c7-9c01-49fd-8399-cc0bf7b37e76 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2034132 Nov 16 03:19:55.922428 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.927517 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ee37d04-696d-4537-99bd-ff47ca674be3 req-c413cf8f-c7ea-477b-9363-3c9fe5ebff85 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1777332 Nov 16 03:19:55.929215 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.953725 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8dd0a85-b891-4f0d-8b1e-5062056fbfec,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:55.967658 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:55.970421 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-446daf24-133d-43b3-bbbd-5c051ae96f4f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3737998 Nov 16 03:19:55.973194 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45842) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:55.979939 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group_rule': {'security_group_id': 'b3b2cefa-a732-4c2d-8879-25a8537d518a', 'project_id': 'f0e656658949487fb898565d34636908', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:56.030738 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.035601 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.063744 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.144683 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e84c70-12d4-4082-b0e5-3b46198c7ad1 None None] Pushing event updated for resources: {'Port': ['ID=a0899499-351a-4f08-8b71-8a19ab6cda2b,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:56.273165 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.283584 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.329597 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3753ebd4-d048-489e-85bc-835269adfdc0,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:56.339502 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Attempting to bind port a0899499-351a-4f08-8b71-8a19ab6cda2b on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:19:56.340793 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Attempting to bind port a0899499-351a-4f08-8b71-8a19ab6cda2b by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:19:56.341725 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Attempting to bind port a0899499-351a-4f08-8b71-8a19ab6cda2b on network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:19:56.354919 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:19:56.355559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Checking segment: {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:19:56.356218 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.356846 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Bound using segment: {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:19:56.391432 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Bound port: a0899499-351a-4f08-8b71-8a19ab6cda2b, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f08d8d97-7a2b-4489-bc72-282380d6b63a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 335, 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:19:56.393244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.421125 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.426365 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-9128d03d-5dcd-4a68-bde5-89f5d05436e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4493377 Nov 16 03:19:56.429940 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 45858) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:56.444793 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group_rule': {'security_group_id': 'b3b2cefa-a732-4c2d-8879-25a8537d518a', 'project_id': 'f0e656658949487fb898565d34636908', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:56.559638 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.654142 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] For port a0899499-351a-4f08-8b71-8a19ab6cda2b, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:19:56.664773 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] For port a0899499-351a-4f08-8b71-8a19ab6cda2b, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a0899499-351a-4f08-8b71-8a19ab6cda2b,segment=NetworkSegment(f08d8d97-7a2b-4489-bc72-282380d6b63a),segment_id=f08d8d97-7a2b-4489-bc72-282380d6b63a)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:19:56.675442 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.735703 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-90691382-d181-40a6-9964-b1cce6261ec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:56.737541 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-90691382-d181-40a6-9964-b1cce6261ec1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 1099 time: 0.1155803 Nov 16 03:19:56.876968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-45cc6096-d28a-412b-9f70-4ec0941d7ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:56.879083 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-45cc6096-d28a-412b-9f70-4ec0941d7ccd service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.1303463 Nov 16 03:19:56.880773 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Routers {'4df3e9d8-80be-4b7b-8046-27014c1ff987'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:19:56.882367 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['4df3e9d8-80be-4b7b-8046-27014c1ff987'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:56.896740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:56.940274 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f388d9a-a320-4e63-8cda-e4ceb2bf2c0f req-a70bb9a8-8ea9-4b83-b96f-6d84a6cf5380 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:56.951055 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4f388d9a-a320-4e63-8cda-e4ceb2bf2c0f req-a70bb9a8-8ea9-4b83-b96f-6d84a6cf5380 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.3183172 Nov 16 03:19:57.018926 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.053248 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-38871133-4639-4f57-bf04-c626cc85f89f None None] Provisioning complete for port a0899499-351a-4f08-8b71-8a19ab6cda2b triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:57.053825 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-38871133-4639-4f57-bf04-c626cc85f89f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.062367 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-323d6637-3b9d-4120-b6c7-2f2186905973 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 200 len: 217 time: 0.1606104 Nov 16 03:19:57.068896 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.070126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6358948 Nov 16 03:19:57.075024 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45880) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:57.083041 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group_rule': {'security_group_id': 'b3b2cefa-a732-4c2d-8879-25a8537d518a', 'project_id': 'f0e656658949487fb898565d34636908', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:57.095055 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e84c70-12d4-4082-b0e5-3b46198c7ad1 None None] Pushing event updated for resources: {'Port': ['ID=a0899499-351a-4f08-8b71-8a19ab6cda2b,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:57.195916 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.securitygroups_db [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Project f0e656658949487fb898565d34636908 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 16 03:19:57.207861 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7eb129-d208-40bb-9cb3-63fafb33d138 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9fbc254-5ec6-4025-a4e6-d6280158ea0d,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:57.211181 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.245183 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] Set router 4df3e9d8-80be-4b7b-8046-27014c1ff987 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:19:57.273783 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-3988452f-cbcc-4c56-9427-eb847649dc80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:57.277450 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-3988452f-cbcc-4c56-9427-eb847649dc80 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.1976972 Nov 16 03:19:57.324260 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-38871133-4639-4f57-bf04-c626cc85f89f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.332636 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.338338 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.369876 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-786f595c-9c13-4838-a07b-5a04a99bc2f0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0769937 Nov 16 03:19:57.407595 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4f388d9a-a320-4e63-8cda-e4ceb2bf2c0f req-dfd523c0-684b-408b-92d0-9d5637a39d16 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4378240 Nov 16 03:19:57.409980 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=198de0b9-48c8-4ede-be9b-a3e006b2ef76,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:57.422087 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-38871133-4639-4f57-bf04-c626cc85f89f None None] For port a0899499-351a-4f08-8b71-8a19ab6cda2b, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a0899499-351a-4f08-8b71-8a19ab6cda2b,segment=NetworkSegment(f08d8d97-7a2b-4489-bc72-282380d6b63a),segment_id=f08d8d97-7a2b-4489-bc72-282380d6b63a)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:19:57.436848 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.438808 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-565d9b1b-a4e8-4d39-9f59-270ed0a67df0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3623672 Nov 16 03:19:57.443306 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45886) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:19:57.453401 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'security_group_rule': {'security_group_id': 'b3b2cefa-a732-4c2d-8879-25a8537d518a', 'project_id': 'f0e656658949487fb898565d34636908', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:19:57.501664 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.securitygroups_db [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Project f0e656658949487fb898565d34636908 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 16 03:19:57.513330 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.520040 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-38871133-4639-4f57-bf04-c626cc85f89f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.608614 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-6ba2b86a-9c10-4b1e-9869-ab065ee0d65a service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1954508 Nov 16 03:19:57.688261 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38871133-4639-4f57-bf04-c626cc85f89f None None] Pushing event updated for resources: {'Port': ['ID=a0899499-351a-4f08-8b71-8a19ab6cda2b,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:57.698672 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.710810 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.755849 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.766545 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3178320 Nov 16 03:19:57.780226 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46e5d58-976b-460a-be56-c065887af835 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f421b8b-a9ec-4ccb-91dc-49edc171aea6,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:19:57.826721 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-610c6ab4-d958-4768-9287-bf9756716ea4 None None] Provisioning complete for port a0899499-351a-4f08-8b71-8a19ab6cda2b triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:19:57.827252 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-610c6ab4-d958-4768-9287-bf9756716ea4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:19:57.950916 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb3a9d1e-798e-44a3-8d70-6bf0aaefebd5 req-ff2b0ea2-f800-4546-9eb4-8c4a06cd547c service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3289337 Nov 16 03:19:58.299617 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:19:50Z', 'revision_number': 4, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': 'a0899499-351a-4f08-8b71-8a19ab6cda2b', 'name': '', 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'mac_address': 'fa:16:3e:f3:ca:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_interface', 'standard_attr_id': 435, 'fixed_ips': [{'subnet_id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:49Z', 'updated_at': '2021-11-16T03:19:56Z', 'revision_number': 4, 'project_id': 'f616d231885846a299f65758235aaa76', 'subnets': [{'id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:19:58.372476 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7f587d-20e9-41cd-aafd-d408ae920944 None None] The sync data for ids ['4df3e9d8-80be-4b7b-8046-27014c1ff987'] in dv-cinder-818037-1-iscsi is: [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:19:50Z', 'revision_number': 4, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': 'a0899499-351a-4f08-8b71-8a19ab6cda2b', 'name': '', 'network_id': 'b1af4650-1ff7-4f03-957a-4c5c8ba142c1', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'mac_address': 'fa:16:3e:f3:ca:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_interface', 'standard_attr_id': 435, 'fixed_ips': [{'subnet_id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:49Z', 'updated_at': '2021-11-16T03:19:56Z', 'revision_number': 4, 'project_id': 'f616d231885846a299f65758235aaa76', 'subnets': [{'id': '7546ff7f-8540-45b0-b867-f6a1fceb9e4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:19:58.397607 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316a95c3-35b2-4001-8c19-3b24a7281420 req-43182b18-1e26-4392-8f19-28d30f3e8eb4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:58.403045 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-316a95c3-35b2-4001-8c19-3b24a7281420 req-43182b18-1e26-4392-8f19-28d30f3e8eb4 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 946 time: 0.1402800 Nov 16 03:19:58.516745 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-316a95c3-35b2-4001-8c19-3b24a7281420 req-032551fa-18ac-4c20-b907-5b6f1eb17c68 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1057301 Nov 16 03:19:58.667517 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec4aca4-44d4-47fa-8cc5-cebfeacd96a7 req-2cbff9cb-ece7-4d32-a5d0-3f7d4804713c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:58.684284 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aec4aca4-44d4-47fa-8cc5-cebfeacd96a7 req-2cbff9cb-ece7-4d32-a5d0-3f7d4804713c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1390648 Nov 16 03:19:58.855363 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aec4aca4-44d4-47fa-8cc5-cebfeacd96a7 req-6525b0a7-d008-45fb-9ecd-51445695a55b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1698771 Nov 16 03:19:59.715442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dcf2e8a-69d0-4042-91c0-e25225bf894b req-7f47a832-be6f-48b7-b50e-be0c637fdc53 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:19:59.729853 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7dcf2e8a-69d0-4042-91c0-e25225bf894b req-7f47a832-be6f-48b7-b50e-be0c637fdc53 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 946 time: 0.1115537 Nov 16 03:19:59.882877 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7dcf2e8a-69d0-4042-91c0-e25225bf894b req-d4d9042e-7804-400c-8d6f-874a8d5c7386 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516840 Nov 16 03:20:00.213366 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 45998) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:00.248685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4142abce-7b95-4c5e-9437-8f7ff3c76023 req-7edcd5da-a6d5-4d90-a5a9-b62263797d73 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:00.252332 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4142abce-7b95-4c5e-9437-8f7ff3c76023 req-7edcd5da-a6d5-4d90-a5a9-b62263797d73 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.2001193 Nov 16 03:20:00.403974 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca601d4f-d832-426d-9a20-d7c7f4d9fb47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:00.512407 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4142abce-7b95-4c5e-9437-8f7ff3c76023 req-f6e45f25-5ee0-473d-adea-66a9731e7039 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2463038 Nov 16 03:20:00.633104 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca601d4f-d832-426d-9a20-d7c7f4d9fb47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:00.646809 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ca601d4f-d832-426d-9a20-d7c7f4d9fb47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:00.678776 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a0899499-351a-4f08-8b71-8a19ab6cda2b up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:00.700958 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ca601d4f-d832-426d-9a20-d7c7f4d9fb47 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=b2e2d087909448898eb62ca5b6aae29a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4846542 Nov 16 03:20:00.701943 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46012) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:00.772386 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-b8734542-2500-4ef3-aef5-6541bee1cd9d tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:00.774830 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-b8734542-2500-4ef3-aef5-6541bee1cd9d tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 946 time: 0.1824038 Nov 16 03:20:00.798988 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca601d4f-d832-426d-9a20-d7c7f4d9fb47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9140d892-968e-4b07-925a-6e7d6101fe01,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:00.851885 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port a0899499-351a-4f08-8b71-8a19ab6cda2b triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:00.853854 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:00.904529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-860063dd-f14a-45de-a269-bb99d4adf568 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:00.982733 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Deleting port d415bab3-aa5f-4d8a-8710-dda8b0b824ce {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:00.983139 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.004202 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-860063dd-f14a-45de-a269-bb99d4adf568 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.131648 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-860063dd-f14a-45de-a269-bb99d4adf568 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.142924 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-860063dd-f14a-45de-a269-bb99d4adf568 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.144165 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-860063dd-f14a-45de-a269-bb99d4adf568 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9140d892-968e-4b07-925a-6e7d6101fe01 HTTP/1.1" status: 204 len: 168 time: 0.4395812 Nov 16 03:20:01.188588 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860063dd-f14a-45de-a269-bb99d4adf568 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9140d892-968e-4b07-925a-6e7d6101fe01,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:01.256003 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4484021-5533-449a-bbdc-df6ae7b5455a req-b46a2aaf-a86b-4e48-b4f0-e0a835aa7732 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:01.257841 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4484021-5533-449a-bbdc-df6ae7b5455a req-b46a2aaf-a86b-4e48-b4f0-e0a835aa7732 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 946 time: 0.1229200 Nov 16 03:20:01.260176 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] For port d415bab3-aa5f-4d8a-8710-dda8b0b824ce, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:01.260685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.293259 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Calling delete_port for d415bab3-aa5f-4d8a-8710-dda8b0b824ce owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:01.388568 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4484021-5533-449a-bbdc-df6ae7b5455a req-5d56d881-076d-418b-94db-703724e4adbf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153510 Nov 16 03:20:01.574637 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.625134 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db', 'da96bbab-7015-473b-bb68-ef95db66868f', '259ab0c6-cf7d-4e66-abd2-94758341d45b', 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:01.653676 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event deleted for resources: {'Port': ['ID=d415bab3-aa5f-4d8a-8710-dda8b0b824ce,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:01.736808 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] No DVR routers for this DVR port d415bab3-aa5f-4d8a-8710-dda8b0b824ce on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:20:01.754371 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:01.758450 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0557e372-c867-4d6f-bea0-6a5f9e0f09c4 req-971f4c52-74ca-40ca-a053-9ff2fb778c49 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "DELETE /v2.0/ports/d415bab3-aa5f-4d8a-8710-dda8b0b824ce HTTP/1.1" status: 204 len: 173 time: 0.9766674 Nov 16 03:20:01.759144 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'name': 'network-vif-deleted', 'tag': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:01.761622 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e46ea205-140d-4624-96e2-ffb3ae7bbe88" -d '{"events": [{"server_uuid": "a955e82c-67c0-4f2f-a00d-4c784505cd9c", "name": "network-vif-deleted", "tag": "d415bab3-aa5f-4d8a-8710-dda8b0b824ce"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:01.794384 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f803de2-de92-42ef-bcea-23bb87a22c88 req-af9cfa5c-5432-40e4-ba74-b714c4aa9967 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:01.803572 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5f803de2-de92-42ef-bcea-23bb87a22c88 req-af9cfa5c-5432-40e4-ba74-b714c4aa9967 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1070924 Nov 16 03:20:01.877985 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ce1a496-7c2c-4200-966d-1c4fdc9eda72 x-openstack-request-id: req-3ce1a496-7c2c-4200-966d-1c4fdc9eda72 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:01.878432 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a955e82c-67c0-4f2f-a00d-4c784505cd9c", "name": "network-vif-deleted", "tag": "d415bab3-aa5f-4d8a-8710-dda8b0b824ce", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:01.878779 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-3ce1a496-7c2c-4200-966d-1c4fdc9eda72 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:01.879754 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a955e82c-67c0-4f2f-a00d-4c784505cd9c', 'name': 'network-vif-deleted', 'tag': 'd415bab3-aa5f-4d8a-8710-dda8b0b824ce', 'status': 'completed', 'code': 200} Nov 16 03:20:01.898207 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5f803de2-de92-42ef-bcea-23bb87a22c88 req-8b8fc047-4047-499f-a4c2-3045ed74315c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936046 Nov 16 03:20:02.319053 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46054) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:02.496850 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.605468 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4743a6bc-e854-48b9-bc74-b88761d4e0aa req-e2b23c2f-0079-43f5-b9c5-c02668b5bf7f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=a955e82c-67c0-4f2f-a00d-4c784505cd9c HTTP/1.1" status: 200 len: 210 time: 0.0364923 Nov 16 03:20:02.663632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.667989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.712529 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=24bad07d6c1c43ed8b61e2fc34acd62f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3930502 Nov 16 03:20:02.713420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf5367ef-e6d5-49e4-89c3-c40cf52a22c1,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:02.715804 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46062) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:02.721385 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.721829 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.722169 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.722500 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.722982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.723458 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.723787 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.724112 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.724435 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.724749 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.725062 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.725590 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6a4356b-d5e6-4e78-9b51-1d9f42b3f384 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.806570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.838416 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.906182 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.912154 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:02.913857 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/bf5367ef-e6d5-49e4-89c3-c40cf52a22c1 HTTP/1.1" status: 204 len: 168 time: 0.1964211 Nov 16 03:20:02.928299 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf5367ef-e6d5-49e4-89c3-c40cf52a22c1,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:02.938866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.938866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.938866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.938866 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.939622 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.939622 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.939622 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.940038 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.940211 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.940560 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.940863 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:02.941151 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b07718-889c-49b1-af86-879900f38acf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:03.136539 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-e4e5c6de-509a-438a-91da-253d159c7ea4 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0600026 Nov 16 03:20:03.242771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-1a25a942-c959-4be7-9da3-c08e31aa5c07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:03.244325 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-1a25a942-c959-4be7-9da3-c08e31aa5c07 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 1098 time: 0.0663843 Nov 16 03:20:03.501495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-35bd34a2-d9bc-4b2d-818f-512c23843365 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:03.503990 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-35bd34a2-d9bc-4b2d-818f-512c23843365 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 200 len: 920 time: 0.2383618 Nov 16 03:20:03.606119 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-9a034f28-e482-4b62-8549-25f3ed25870b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=437cd5b7-c458-4185-9487-1110be169765 HTTP/1.1" status: 200 len: 217 time: 0.0793633 Nov 16 03:20:03.705966 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-00758a83-8292-46ef-a18a-0325174b3fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:03.708114 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-00758a83-8292-46ef-a18a-0325174b3fe8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 200 len: 859 time: 0.0945215 Nov 16 03:20:03.752479 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-8ba652ee-3327-4599-b0fd-5634b9c6f1f9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b8800875-2e98-4cb6-a3a9-9d5ee637458a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0347004 Nov 16 03:20:03.968715 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-0791787d-2180-42be-8344-d6c9c4101986 service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2086112 Nov 16 03:20:04.129796 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e861a68a-77bb-463a-8f40-8455eafd8d87 req-5e5609df-1dee-4d29-82c8-7b1c7ce03c0c service neutron] 10.222.0.11 "GET /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1527889 Nov 16 03:20:04.136785 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46152) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:04.296326 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-786760365-network', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:04.321205 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Made reservation on behalf of 76754ec1f4b143ceabbcb17af1aa513b for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:04.324494 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.337248 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.427166 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.432800 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.456142 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 337} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:20:04.471628 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=baadeb48-7237-4752-a8bf-62e69b7ab85b,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:04.478831 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.479172 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Added segment 25def757-4057-49a6-b5ef-3a5e0b9904b2 of type vlan for network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef Nov 16 03:20:04.536764 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.578927 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.580048 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:04.580677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.650806 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5122209 Nov 16 03:20:04.654449 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46160) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:04.661919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Request body: {'subnet': {'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-786760365-subnet', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:04.664267 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ac7bb3-3951-4bfc-bd79-61e10b447729 admin admin] Pushing event updated for resources: {'Network': ['ID=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:04.675194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:20:04.692430 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Made reservation on behalf of 76754ec1f4b143ceabbcb17af1aa513b for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:04.695171 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.906098 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:04.967764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e24021b9-c30d-4d4e-b10a-332e32fda211,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:04.971637 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d415bab3-aa5f-4d8a-8710-dda8b0b824ce no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:04.982285 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Checking segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:04.982644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Network hostable DHCP agents. Network: 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:20:05.005807 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:20:05.023650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:05.029306 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:05.030468 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.042435 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: d415bab3-aa5f-4d8a-8710-dda8b0b824ce {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:05.044121 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d415bab3-aa5f-4d8a-8710-dda8b0b824ce not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:05.049994 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c7a34b7-076e-4c54-9b71-26a0c419bcd1 None None] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:05.062380 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-78788741-7eec-4742-b920-1eed8a542b99 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4061236 Nov 16 03:20:05.069545 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46168) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:05.079907 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:05.141531 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.146102 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.262182 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.341224 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46178) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:05.413820 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Deleting subnet 3f3c14a6-0800-4695-88cb-f795756f0d94 {{(pid=101899) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:20:05.418889 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.487337 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129335955'] for subnet, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.537890 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:20:05.538207 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.538408 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.538665 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29037430-43e1-44d7-969d-efb4a9ca1d09 req-3393fe2c-c2c6-4985-b710-5f1c9b3931d2 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:05.542291 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-29037430-43e1-44d7-969d-efb4a9ca1d09 req-3393fe2c-c2c6-4985-b710-5f1c9b3931d2 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.1010184 Nov 16 03:20:05.551445 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.643285 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-29037430-43e1-44d7-969d-efb4a9ca1d09 req-d34549b1-a7ce-418b-8b96-1f9676385690 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957637 Nov 16 03:20:05.666038 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126058139', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126233428'] for subnet, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.714862 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3f3c14a6-0800-4695-88cb-f795756f0d94,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:05.724569 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.728460 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d2154b8e-36c1-4d91-ac4b-5581ed7795bb admin admin] 10.222.0.31 "DELETE /v2.0/subnets/3f3c14a6-0800-4695-88cb-f795756f0d94 HTTP/1.1" status: 204 len: 168 time: 0.3857918 Nov 16 03:20:05.732657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46182) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:05.820080 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.828625 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.847199 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Allocated IP 172.20.0.2 (3d7e4ea5-05db-41ca-8436-96b38d0ef4ef/e24021b9-c30d-4d4e-b10a-332e32fda211/a408a5bf-cfc4-4a7b-8915-40551a3c2e41) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:05.903968 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.942778 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.958481 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:05.993313 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['64a8f161-35b6-4fac-a77e-b81459bbc083']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:06.008444 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f570f171-eae9-4b0b-8ea1-0350983b2fe0') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:06.008902 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f570f171-eae9-4b0b-8ea1-0350983b2fe0') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:06.027817 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.048494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.060337 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Releasing vlan 326 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:20:06.061001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:20:06.063518 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:20:06.075904 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.089334 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.135142 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Allocated IP 172.27.1.178 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/93c3618c-4f4c-42ad-9e08-086de4fab231) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:06.141239 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.141935 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:06.145754 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:06.153548 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.157055 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] 10.222.0.31 "DELETE /v2.0/networks/64a8f161-35b6-4fac-a77e-b81459bbc083 HTTP/1.1" status: 204 len: 168 time: 0.4230156 Nov 16 03:20:06.161578 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Pushing event updated for resources: {'Port': ['ID=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:06.166131 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:06.171626 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d039558f-49a8-444d-ad08-359f90f31579 admin admin] Pushing event deleted for resources: {'Network': ['ID=64a8f161-35b6-4fac-a77e-b81459bbc083,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:06.250084 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Attempting to bind port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:06.250417 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Attempting to bind port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:06.251148 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Attempting to bind port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 on network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:06.261015 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:06.261451 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Checking segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:06.262236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.262837 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Bound using segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:06.263339 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Bound port: a408a5bf-cfc4-4a7b-8915-40551a3c2e41, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:06.263731 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.344171 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] For port a408a5bf-cfc4-4a7b-8915-40551a3c2e41, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:06.350173 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] For port a408a5bf-cfc4-4a7b-8915-40551a3c2e41, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:06.351727 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.359149 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.369971 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46190) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:06.425108 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.465175 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-62ff9930-b0bd-4b6e-a893-61bd603d9832 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=7abc18a290264877b7cce57e27056ccf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0897479 Nov 16 03:20:06.466042 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46194) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:06.480257 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb4a40e-bae6-4c65-a471-2e3046bccbd9 None None] Pushing event updated for resources: {'Port': ['ID=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:06.516632 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:06.517305 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Pushing event updated for resources: {'Port': ['ID=93c3618c-4f4c-42ad-9e08-086de4fab231,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:06.530428 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:06.533115 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:06.577181 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe0645a2-ab25-44f6-8db6-2d9f5a76ef17 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.603270 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe0645a2-ab25-44f6-8db6-2d9f5a76ef17 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.643040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a79ff86-519d-4963-8972-611848b30070 req-f6189dc1-e8cc-4075-bb9a-506a1c9e2f89 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:06.644780 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0a79ff86-519d-4963-8972-611848b30070 req-f6189dc1-e8cc-4075-bb9a-506a1c9e2f89 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1178737 Nov 16 03:20:06.768982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe0645a2-ab25-44f6-8db6-2d9f5a76ef17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.773226 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe0645a2-ab25-44f6-8db6-2d9f5a76ef17 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:06.776585 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-fe0645a2-ab25-44f6-8db6-2d9f5a76ef17 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/eaaa09dd-6539-448f-b3ed-4a46282d5242 HTTP/1.1" status: 204 len: 168 time: 0.3066432 Nov 16 03:20:06.794437 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0a79ff86-519d-4963-8972-611848b30070 req-cf33ef29-f183-4020-8f53-399f338c5838 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1403136 Nov 16 03:20:06.822923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0645a2-ab25-44f6-8db6-2d9f5a76ef17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eaaa09dd-6539-448f-b3ed-4a46282d5242,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:06.889471 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176f270d-6af0-4819-bbd4-6cb1dba12ca8 req-86be703b-e6e7-4e52-9070-6f09dfe5d613 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:06.891800 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-176f270d-6af0-4819-bbd4-6cb1dba12ca8 req-86be703b-e6e7-4e52-9070-6f09dfe5d613 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0911579 Nov 16 03:20:06.970720 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-176f270d-6af0-4819-bbd4-6cb1dba12ca8 req-14392b2e-b4cf-4c29-9ad5-de5262038805 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712032 Nov 16 03:20:07.021001 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:07.175305 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-df140f3b-887a-4700-8c71-d099d8da935b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:07.177727 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-df140f3b-887a-4700-8c71-d099d8da935b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.0962217 Nov 16 03:20:07.309725 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Deleting port 259ab0c6-cf7d-4e66-abd2-94758341d45b {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:07.310061 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:07.310233 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:07.581195 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101898) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:20:07.838075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:07.853455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] For port 259ab0c6-cf7d-4e66-abd2-94758341d45b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=259ab0c6-cf7d-4e66-abd2-94758341d45b,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:07.853455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:07.856118 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Sync routers for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:07.872540 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Calling delete_port for 259ab0c6-cf7d-4e66-abd2-94758341d45b owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:07.882714 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:07.883607 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:07.892570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:07.894211 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f14773a6-1553-4775-923d-ccff4cd44b2b admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.8228028 Nov 16 03:20:07.898237 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46222) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:07.925623 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11a3366f-723f-41f1-829a-916ace63af00 None None] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:08.033373 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-fb8abd3c-7d40-421f-a859-fe1ec043441d None None] Provisioning complete for port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:08.038339 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fb8abd3c-7d40-421f-a859-fe1ec043441d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.062263 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:08.140805 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:20:08.313107 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:06Z', 'revision_number': 3, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:08.340607 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d37e8049-de2a-42fc-a8cf-1218d0f05d07 req-6c738922-1c40-4324-ab36-e4a15df66d39 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:08.346882 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d37e8049-de2a-42fc-a8cf-1218d0f05d07 req-6c738922-1c40-4324-ab36-e4a15df66d39 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.2485635 Nov 16 03:20:08.377675 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55fdf4b7-88f2-4cec-9b31-ed4e9b44ac27 req-a052e8fb-719b-4886-939e-6e85d5cc7a46 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:08.381039 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-55fdf4b7-88f2-4cec-9b31-ed4e9b44ac27 req-a052e8fb-719b-4886-939e-6e85d5cc7a46 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 946 time: 0.2130325 Nov 16 03:20:08.382803 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Checking router: 0f03a58b-d978-4d06-8b7c-905f27fd0d8a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:08.383657 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Updating router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a port 93c3618c-4f4c-42ad-9e08-086de4fab231 binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:20:08.422126 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fb8abd3c-7d40-421f-a859-fe1ec043441d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.434234 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.472803 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-fb8abd3c-7d40-421f-a859-fe1ec043441d None None] For port a408a5bf-cfc4-4a7b-8915-40551a3c2e41, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:08.480656 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fb8abd3c-7d40-421f-a859-fe1ec043441d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.559216 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8abd3c-7d40-421f-a859-fe1ec043441d None None] Pushing event updated for resources: {'Port': ['ID=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:08.610841 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d37e8049-de2a-42fc-a8cf-1218d0f05d07 req-2ecba427-282f-43ca-ab51-0c13c4b3aa2e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2452247 Nov 16 03:20:08.679660 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a408a5bf-cfc4-4a7b-8915-40551a3c2e41 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:08.753513 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:08.754643 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.836211 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.885242 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-55fdf4b7-88f2-4cec-9b31-ed4e9b44ac27 req-3826f3e9-73a5-40cc-b0c3-6fce797fa698 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3842919 Nov 16 03:20:08.888378 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event deleted for resources: {'Port': ['ID=259ab0c6-cf7d-4e66-abd2-94758341d45b,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:08.945481 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.948993 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db', 'da96bbab-7015-473b-bb68-ef95db66868f', '259ab0c6-cf7d-4e66-abd2-94758341d45b'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:08.950704 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:08.994714 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] No DVR routers for this DVR port 259ab0c6-cf7d-4e66-abd2-94758341d45b on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:20:08.998801 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.002506 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4ca47c2-1602-4a16-acc8-1a858b9d8ead req-2d62a119-b8c4-46b0-b8a7-08ec8d8b9d4f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "DELETE /v2.0/ports/259ab0c6-cf7d-4e66-abd2-94758341d45b HTTP/1.1" status: 204 len: 173 time: 1.8168445 Nov 16 03:20:09.006351 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'name': 'network-vif-deleted', 'tag': '259ab0c6-cf7d-4e66-abd2-94758341d45b'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:09.009461 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f3ecca6-bf43-4e98-b6d6-24e5b4e13e6f" -d '{"events": [{"server_uuid": "5fdf0855-de57-4e84-ba51-6e27db495f65", "name": "network-vif-deleted", "tag": "259ab0c6-cf7d-4e66-abd2-94758341d45b"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:09.037388 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Attempting to bind port 93c3618c-4f4c-42ad-9e08-086de4fab231 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:09.038183 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Attempting to bind port 93c3618c-4f4c-42ad-9e08-086de4fab231 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:09.040075 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Attempting to bind port 93c3618c-4f4c-42ad-9e08-086de4fab231 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:09.080632 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:09.085818 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:09.086139 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab2d8bb7-ec60-4fed-8d05-10bdb3778e64 x-openstack-request-id: req-ab2d8bb7-ec60-4fed-8d05-10bdb3778e64 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:09.086468 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.086668 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5fdf0855-de57-4e84-ba51-6e27db495f65", "name": "network-vif-deleted", "tag": "259ab0c6-cf7d-4e66-abd2-94758341d45b", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:09.086942 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ab2d8bb7-ec60-4fed-8d05-10bdb3778e64 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:09.087238 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:09.087937 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Bound port: 93c3618c-4f4c-42ad-9e08-086de4fab231, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:09.088680 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.089037 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5fdf0855-de57-4e84-ba51-6e27db495f65', 'name': 'network-vif-deleted', 'tag': '259ab0c6-cf7d-4e66-abd2-94758341d45b', 'status': 'completed', 'code': 200} Nov 16 03:20:09.116602 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-b866f6f7-9c89-4703-b962-a8707433ff24 None None] Provisioning complete for port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:09.117371 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b866f6f7-9c89-4703-b962-a8707433ff24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.157324 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd10d43b-cd34-49de-bd1f-13e2f391f367 None None] Pushing event updated for resources: {'Port': ['ID=93c3618c-4f4c-42ad-9e08-086de4fab231,revision_number=2']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:09.262491 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] For port 93c3618c-4f4c-42ad-9e08-086de4fab231, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:09.269934 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] For port 93c3618c-4f4c-42ad-9e08-086de4fab231, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=93c3618c-4f4c-42ad-9e08-086de4fab231,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:09.282348 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.294954 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-b145abb8-dfe3-4bc8-b78f-4076bbaacbf0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:09.296632 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-b145abb8-dfe3-4bc8-b78f-4076bbaacbf0 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1611152 Nov 16 03:20:09.418768 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd10d43b-cd34-49de-bd1f-13e2f391f367 None None] Pushing event updated for resources: {'Port': ['ID=93c3618c-4f4c-42ad-9e08-086de4fab231,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:09.460479 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:09.462683 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:09.498630 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.626541 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:09.627098 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Deleting port 437cd5b7-c458-4185-9487-1110be169765 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:09.627656 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.898585 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561b7940-2a7c-43df-9bff-2e2d5e026c26 req-a5a0114c-ad42-4230-aaaf-6c176d842ebe tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:09.900283 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-561b7940-2a7c-43df-9bff-2e2d5e026c26 req-a5a0114c-ad42-4230-aaaf-6c176d842ebe tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 945 time: 0.1839361 Nov 16 03:20:09.955588 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] For port 437cd5b7-c458-4185-9487-1110be169765, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=437cd5b7-c458-4185-9487-1110be169765,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:09.955954 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:09.995199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Calling delete_port for 437cd5b7-c458-4185-9487-1110be169765 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:10.027816 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Allocated IP 172.20.0.1 (3d7e4ea5-05db-41ca-8436-96b38d0ef4ef/e24021b9-c30d-4d4e-b10a-332e32fda211/18838d54-2a88-461c-8662-98ba7ad9f972) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:10.041599 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:06Z', 'revision_number': 3, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:10.091356 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-476e5cb9-fc1b-4475-aa10-9bc090901088 None None] The sync data for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi is: [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:06Z', 'revision_number': 3, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:10.137792 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-561b7940-2a7c-43df-9bff-2e2d5e026c26 req-16d0f3be-2f3f-4b92-9802-a66c6a4b56d1 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2140384 Nov 16 03:20:10.212425 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-184e5874-708b-4db0-a000-c2528dacecbd req-c4f31a3e-eb10-499c-acc9-c79436204efc tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=5fdf0855-de57-4e84-ba51-6e27db495f65 HTTP/1.1" status: 200 len: 210 time: 0.0712106 Nov 16 03:20:10.313563 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:10.389571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:10.449656 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['437cd5b7-c458-4185-9487-1110be169765', 'c7ca7b87-66b6-45ce-9656-e62a40792408'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:10.493227 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Pushing event deleted for resources: {'Port': ['ID=437cd5b7-c458-4185-9487-1110be169765,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:10.537713 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:10.557507 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a408a5bf-cfc4-4a7b-8915-40551a3c2e41 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:10.603273 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] No DVR routers for this DVR port 437cd5b7-c458-4185-9487-1110be169765 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:20:10.607998 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:10.616070 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-461cf9ad-c94e-4aae-bd16-9b260427beef req-bad9841b-a616-4ffa-85dd-12bf9e9970f9 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "DELETE /v2.0/ports/437cd5b7-c458-4185-9487-1110be169765 HTTP/1.1" status: 204 len: 173 time: 1.2829294 Nov 16 03:20:10.631390 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:10.635909 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:10.647011 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Pushing event updated for resources: {'Port': ['ID=18838d54-2a88-461c-8662-98ba7ad9f972,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:10.653736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:10.729162 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:10.735462 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:10.736026 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:10.985709 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 259ab0c6-cf7d-4e66-abd2-94758341d45b no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:11.017605 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 259ab0c6-cf7d-4e66-abd2-94758341d45b {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:11.018192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 259ab0c6-cf7d-4e66-abd2-94758341d45b not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:11.051205 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:11.098690 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-0546861a-e87b-45bc-a4ed-c7f14994bafd None None] Provisioning complete for port 18838d54-2a88-461c-8662-98ba7ad9f972 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:11.099097 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0546861a-e87b-45bc-a4ed-c7f14994bafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:11.106483 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12b32c77-f241-4147-abf7-2b54d564588a', 'name': 'network-vif-deleted', 'tag': '437cd5b7-c458-4185-9487-1110be169765'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:11.108811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dcc00e4f-24d8-4a33-a5b3-42697bf0dab2" -d '{"events": [{"server_uuid": "12b32c77-f241-4147-abf7-2b54d564588a", "name": "network-vif-deleted", "tag": "437cd5b7-c458-4185-9487-1110be169765"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:11.137911 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-0546861a-e87b-45bc-a4ed-c7f14994bafd None None] Port 18838d54-2a88-461c-8662-98ba7ad9f972 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:11.181510 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8010f6f0-7a11-4e12-b488-278810ffd710 x-openstack-request-id: req-8010f6f0-7a11-4e12-b488-278810ffd710 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:11.181801 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "12b32c77-f241-4147-abf7-2b54d564588a", "name": "network-vif-deleted", "tag": "437cd5b7-c458-4185-9487-1110be169765", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:11.182053 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-8010f6f0-7a11-4e12-b488-278810ffd710 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:11.182452 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '12b32c77-f241-4147-abf7-2b54d564588a', 'name': 'network-vif-deleted', 'tag': '437cd5b7-c458-4185-9487-1110be169765', 'status': 'completed', 'code': 200} Nov 16 03:20:11.354346 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-14f6ee36-c06f-4e31-8044-f7c2486fdb93 req-24579f6c-1cc9-42e2-a40a-cb5a93b52c96 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=12b32c77-f241-4147-abf7-2b54d564588a HTTP/1.1" status: 200 len: 210 time: 0.0471792 Nov 16 03:20:11.374507 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:11.387582 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:11.515134 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Pushing event updated for resources: {'Port': ['ID=18838d54-2a88-461c-8662-98ba7ad9f972,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:11.523998 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:11.679903 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b9fc0af-481c-4437-946a-8ac0f054e1c2 req-ad5eb932-f004-4908-8270-c70b7d8e286f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:11.681876 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b9fc0af-481c-4437-946a-8ac0f054e1c2 req-ad5eb932-f004-4908-8270-c70b7d8e286f tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 945 time: 0.0920436 Nov 16 03:20:11.693266 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:11.695531 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:11.915761 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b9fc0af-481c-4437-946a-8ac0f054e1c2 req-b157512f-e6a5-4994-823b-759c34a35974 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2173722 Nov 16 03:20:11.958440 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:20:11.972317 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8d65d553-20f2-409e-86af-87958ac7c5c2 None None] Provisioning complete for port 18838d54-2a88-461c-8662-98ba7ad9f972 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:11.974278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8d65d553-20f2-409e-86af-87958ac7c5c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:12.042802 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8d65d553-20f2-409e-86af-87958ac7c5c2 None None] Port 18838d54-2a88-461c-8662-98ba7ad9f972 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:12.459968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:12.467395 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-fd881048-4d1a-4ffe-8f8b-03995e814e79 admin admin] 10.222.0.31 "PUT /v2.0/routers/0f03a58b-d978-4d06-8b7c-905f27fd0d8a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5673432 Nov 16 03:20:12.490983 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46286) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:12.537081 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Sync routers for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:12.574720 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:12.575930 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:12.702450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-671aecbf-4eca-411c-a5ea-91f8a65d7fb3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:12.748331 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 93c3618c-4f4c-42ad-9e08-086de4fab231 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:12.893173 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-671aecbf-4eca-411c-a5ea-91f8a65d7fb3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:12.918618 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-671aecbf-4eca-411c-a5ea-91f8a65d7fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:12.989002 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-671aecbf-4eca-411c-a5ea-91f8a65d7fb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c6e0528-cb25-4f74-aeec-520b44dc4033,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:13.006990 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-671aecbf-4eca-411c-a5ea-91f8a65d7fb3 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=96374743e52b427cb9c37ff40c90c66c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5145972 Nov 16 03:20:13.011482 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46298) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:13.030984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f5ed58-f27e-4602-aa6f-f4a5319e5d33 req-b5aa5cae-9d46-47de-88be-6fb8f9ae9174 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:13.032121 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-05f5ed58-f27e-4602-aa6f-f4a5319e5d33 req-b5aa5cae-9d46-47de-88be-6fb8f9ae9174 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1625721 Nov 16 03:20:13.058587 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 437cd5b7-c458-4185-9487-1110be169765 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:13.173911 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:13.189597 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad574755-a77e-416b-8630-470b51e2de48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.191389 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-05f5ed58-f27e-4602-aa6f-f4a5319e5d33 req-f4981606-6ca0-471e-9d21-98ce3975dc24 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1451690 Nov 16 03:20:13.216748 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732610e0-9a2a-4c9e-9225-37f67071a1cd req-950cb315-268e-421b-8fb9-8fc53b8c6e0b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:13.218676 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-732610e0-9a2a-4c9e-9225-37f67071a1cd req-950cb315-268e-421b-8fb9-8fc53b8c6e0b tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 945 time: 0.1064668 Nov 16 03:20:13.228325 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-54e2dee0-42d3-4255-bdae-a7272adf22bf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:13.230006 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-54e2dee0-42d3-4255-bdae-a7272adf22bf tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 945 time: 0.1023905 Nov 16 03:20:13.281201 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad574755-a77e-416b-8630-470b51e2de48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.334515 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 437cd5b7-c458-4185-9487-1110be169765 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:13.335429 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 437cd5b7-c458-4185-9487-1110be169765 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:13.398401 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-732610e0-9a2a-4c9e-9225-37f67071a1cd req-e496fde3-42eb-438a-841b-ea5e34f2e94e tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1671200 Nov 16 03:20:13.412715 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad574755-a77e-416b-8630-470b51e2de48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.416265 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad574755-a77e-416b-8630-470b51e2de48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.421183 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ad574755-a77e-416b-8630-470b51e2de48 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1c6e0528-cb25-4f74-aeec-520b44dc4033 HTTP/1.1" status: 204 len: 168 time: 0.4044821 Nov 16 03:20:13.432342 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad574755-a77e-416b-8630-470b51e2de48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c6e0528-cb25-4f74-aeec-520b44dc4033,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:13.450435 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Deleting port da96bbab-7015-473b-bb68-ef95db66868f {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:13.451502 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.505759 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 93c3618c-4f4c-42ad-9e08-086de4fab231 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:13.506019 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.534038 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46312) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:13.553840 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1727128492-network', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:13.620451 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Made reservation on behalf of ba3f648fc9dd4cd3b5f5d20f45efc3fe for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:13.624125 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.640610 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.668890 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] For port da96bbab-7015-473b-bb68-ef95db66868f, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=da96bbab-7015-473b-bb68-ef95db66868f,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:13.669997 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.697840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Calling delete_port for da96bbab-7015-473b-bb68-ef95db66868f owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:13.791661 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.799709 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.853249 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 301} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:20:13.875930 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9839d4a9-1d1d-4a8d-a332-c0bb734ceb93,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:13.881110 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.881110 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Added segment b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f of type vlan for network 9718c5ed-4646-4da1-b02e-63257534ec52 Nov 16 03:20:13.900170 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.923519 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.935151 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.956182 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 93c3618c-4f4c-42ad-9e08-086de4fab231, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=93c3618c-4f4c-42ad-9e08-086de4fab231,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:13.972582 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.976779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.978182 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:13.982346 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:13.992900 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db', 'da96bbab-7015-473b-bb68-ef95db66868f'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:13.998091 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event deleted for resources: {'Port': ['ID=da96bbab-7015-473b-bb68-ef95db66868f,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:14.060085 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5246291 Nov 16 03:20:14.063580 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46328) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:14.073385 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Request body: {'subnet': {'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1727128492-subnet', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:14.080336 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 2, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:14.085770 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3159f0be-6903-418d-95fa-3c95485a779c admin admin] Pushing event updated for resources: {'Network': ['ID=9718c5ed-4646-4da1-b02e-63257534ec52,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:14.107287 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] No DVR routers for this DVR port da96bbab-7015-473b-bb68-ef95db66868f on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:20:14.119734 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.128518 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e9a2787d-8c62-48bd-8e0e-1d4a5f651fb1 req-16dfa2d4-1286-48ae-b2bb-4be6e6ea9942 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "DELETE /v2.0/ports/da96bbab-7015-473b-bb68-ef95db66868f HTTP/1.1" status: 204 len: 173 time: 0.8877692 Nov 16 03:20:14.132565 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Made reservation on behalf of ba3f648fc9dd4cd3b5f5d20f45efc3fe for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:14.132773 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'name': 'network-vif-deleted', 'tag': 'da96bbab-7015-473b-bb68-ef95db66868f'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:14.137903 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c969aa8f-ae5f-4564-9e96-1e9c35ae9eac" -d '{"events": [{"server_uuid": "420fb8d2-4f97-4506-838c-080e5a17d65f", "name": "network-vif-deleted", "tag": "da96bbab-7015-473b-bb68-ef95db66868f"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:14.141732 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-128616602'] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.188278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 9718c5ed-4646-4da1-b02e-63257534ec52 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:20:14.195484 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Checking router: 0f03a58b-d978-4d06-8b7c-905f27fd0d8a for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:14.195842 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Updating router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a port 18838d54-2a88-461c-8662-98ba7ad9f972 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:20:14.217057 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ffacbdf8-0a8a-4ff1-84c9-f863edc17a2e x-openstack-request-id: req-ffacbdf8-0a8a-4ff1-84c9-f863edc17a2e {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:14.217860 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "420fb8d2-4f97-4506-838c-080e5a17d65f", "name": "network-vif-deleted", "tag": "da96bbab-7015-473b-bb68-ef95db66868f", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:14.218601 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ffacbdf8-0a8a-4ff1-84c9-f863edc17a2e {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:14.219458 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '420fb8d2-4f97-4506-838c-080e5a17d65f', 'name': 'network-vif-deleted', 'tag': 'da96bbab-7015-473b-bb68-ef95db66868f', 'status': 'completed', 'code': 200} Nov 16 03:20:14.290246 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.400581 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=93c3618c-4f4c-42ad-9e08-086de4fab231,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:14.458907 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-661a3389-5d28-4371-9a59-cdbf5f607eb7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.502396 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-128585965', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-128616584'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.565903 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d0585411-56ad-49f6-aff5-68e4e82ba7bd,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:14.629254 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Checking segment: {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:14.630070 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Network hostable DHCP agents. Network: 9718c5ed-4646-4da1-b02e-63257534ec52, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:20:14.641374 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7fdd5d18-42cc-46ca-80b4-ec84502362b6 req-f00daae6-9d13-4fa5-9dd5-e53110971dd1 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=420fb8d2-4f97-4506-838c-080e5a17d65f HTTP/1.1" status: 200 len: 210 time: 0.0434732 Nov 16 03:20:14.673999 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Network 9718c5ed-4646-4da1-b02e-63257534ec52 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:20:14.691046 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 9718c5ed-4646-4da1-b02e-63257534ec52) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:14.698567 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:14.699180 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.724349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0e7402a-1a38-4538-a309-a44ab3dbdfd7 req-58b89d68-0a00-4bf5-adaf-da8fe4a6b2b3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:14.726020 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e0e7402a-1a38-4538-a309-a44ab3dbdfd7 req-58b89d68-0a00-4bf5-adaf-da8fe4a6b2b3 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.0830853 Nov 16 03:20:14.742698 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-0e0b3a40-5e5d-4416-be06-6190d261dbf1 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6775765 Nov 16 03:20:14.747989 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46354) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:14.758733 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:14.772923 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4a61ff6-5ac8-4564-b361-f3e0b2dc3099 None None] Network 9718c5ed-4646-4da1-b02e-63257534ec52 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:14.795435 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e0e7402a-1a38-4538-a309-a44ab3dbdfd7 req-6c2d5d4f-06ed-480e-bfef-c89022ab3cd4 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624380 Nov 16 03:20:14.819686 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.822715 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:14.882780 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46356) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:14.961928 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.064940 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-771494801-network', 'tenant_id': 'ec26dd4c49f74ef7b1b41c9d379e7aa6'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:15.107321 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Made reservation on behalf of ec26dd4c49f74ef7b1b41c9d379e7aa6 for: {'network': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:15.114374 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.114975 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.130831 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.132252 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.229820 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef5fbe7-56f4-4993-a916-e16f94cb99c4 None None] Pushing event updated for resources: {'Port': ['ID=18838d54-2a88-461c-8662-98ba7ad9f972,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:15.258997 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-9718c5ed-4646-4da1-b02e-63257534ec52', 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'fixed_ips': [{'subnet_id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:20:15.259938 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.281585 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.290982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.325951 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Attempting to bind port 18838d54-2a88-461c-8662-98ba7ad9f972 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:15.326317 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Attempting to bind port 18838d54-2a88-461c-8662-98ba7ad9f972 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:15.326674 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Attempting to bind port 18838d54-2a88-461c-8662-98ba7ad9f972 on network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:15.336440 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:15.336856 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Checking segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:15.337229 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.337679 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Bound using segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:15.338267 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Bound port: 18838d54-2a88-461c-8662-98ba7ad9f972, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:15.338546 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.360211 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 321} {{(pid=101899) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:20:15.382659 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c649fc7-cfdb-48c7-841e-548f560a2e77,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:15.397715 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.398287 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.segments_db [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Added segment a588d9a5-69c1-45a5-8a3e-1710c2c5fde9 of type vlan for network b79535bc-1164-4d3a-bbe9-6176a19d036c Nov 16 03:20:15.420132 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.471103 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.514408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.515742 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:15.516334 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.567277 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] For port 18838d54-2a88-461c-8662-98ba7ad9f972, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:15.574115 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] For port 18838d54-2a88-461c-8662-98ba7ad9f972, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=18838d54-2a88-461c-8662-98ba7ad9f972,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:15.575939 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Allocated IP 172.20.0.2 (9718c5ed-4646-4da1-b02e-63257534ec52/d0585411-56ad-49f6-aff5-68e4e82ba7bd/1e2f4993-ec18-42fa-8228-1bee6190ecb5) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:15.586072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.611076 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.7254086 Nov 16 03:20:15.616033 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46362) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:15.624028 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Request body: {'subnet': {'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-771494801-subnet', 'tenant_id': 'ec26dd4c49f74ef7b1b41c9d379e7aa6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:15.657592 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d018ed8-3571-44fb-92af-e78d83901850 admin admin] Pushing event updated for resources: {'Network': ['ID=b79535bc-1164-4d3a-bbe9-6176a19d036c,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:15.692168 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network b79535bc-1164-4d3a-bbe9-6176a19d036c details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:20:15.695589 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Made reservation on behalf of ec26dd4c49f74ef7b1b41c9d379e7aa6 for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:15.707456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.751486 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-bb5b9c54-5c06-417c-830f-c587e122724e None None] Provisioning complete for port 18838d54-2a88-461c-8662-98ba7ad9f972 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:15.752070 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-bb5b9c54-5c06-417c-830f-c587e122724e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.781242 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.818962 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:15.853723 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef5fbe7-56f4-4993-a916-e16f94cb99c4 None None] Pushing event updated for resources: {'Port': ['ID=18838d54-2a88-461c-8662-98ba7ad9f972,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:16.003648 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:16.004704 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:16.006158 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Allocated IP 172.27.1.216 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/0b1cf2da-edeb-4070-b40d-fbc30d8735db) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:16.197118 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.215826 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.238324 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27eb870-c7b4-44d1-8425-74516fe69ff8 req-08a73fc6-61f1-4edf-ad3e-b8e4e5db3843 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:16.242644 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c27eb870-c7b4-44d1-8425-74516fe69ff8 req-08a73fc6-61f1-4edf-ad3e-b8e4e5db3843 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1434932 Nov 16 03:20:16.255676 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.310164 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:16.316644 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:16.319768 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:16.362906 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Pushing event updated for resources: {'Port': ['ID=0b1cf2da-edeb-4070-b40d-fbc30d8735db,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:16.376106 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Pushing event updated for resources: {'Subnet': ['ID=eb17dc2c-fa73-481e-b845-85a7c8e8df27,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:16.413307 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.450148 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.455083 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c27eb870-c7b4-44d1-8425-74516fe69ff8 req-db48631e-25de-4a1e-9396-90efde2d5746 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1624992 Nov 16 03:20:16.459973 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Checking segment: {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:16.460537 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Network hostable DHCP agents. Network: b79535bc-1164-4d3a-bbe9-6176a19d036c, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:20:16.484370 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:16.509856 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Network b79535bc-1164-4d3a-bbe9-6176a19d036c is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:20:16.528219 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, b79535bc-1164-4d3a-bbe9-6176a19d036c) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:16.536276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:16.544566 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.549944 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e31b0074-795c-4e66-a0f1-107bf4418517 None None] Network b79535bc-1164-4d3a-bbe9-6176a19d036c requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:16.575426 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-bb5b9c54-5c06-417c-830f-c587e122724e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.583759 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Network 9718c5ed-4646-4da1-b02e-63257534ec52 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:16.618568 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-0f4e8132-e711-42c3-9115-a37fd209d14a admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9859526 Nov 16 03:20:16.630798 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:16.639586 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:16.659370 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 93c3618c-4f4c-42ad-9e08-086de4fab231 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:16.671416 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Pushing event updated for resources: {'Port': ['ID=1e2f4993-ec18-42fa-8228-1bee6190ecb5,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:16.836577 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.859470 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-bb5b9c54-5c06-417c-830f-c587e122724e None None] For port 18838d54-2a88-461c-8662-98ba7ad9f972, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=18838d54-2a88-461c-8662-98ba7ad9f972,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:16.891187 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-bb5b9c54-5c06-417c-830f-c587e122724e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:16.975218 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Attempting to bind port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:16.975755 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Attempting to bind port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:16.976186 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Attempting to bind port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 on network 9718c5ed-4646-4da1-b02e-63257534ec52 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:17.000561 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device da96bbab-7015-473b-bb68-ef95db66868f no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:17.043587 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:17.044066 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Checking segment: {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:17.044350 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.044743 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Bound using segment: {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:17.045236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Bound port: 1e2f4993-ec18-42fa-8228-1bee6190ecb5, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:17.045650 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.082400 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: da96bbab-7015-473b-bb68-ef95db66868f {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:17.082822 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device da96bbab-7015-473b-bb68-ef95db66868f not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:17.097319 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5b9c54-5c06-417c-830f-c587e122724e None None] Pushing event updated for resources: {'Port': ['ID=18838d54-2a88-461c-8662-98ba7ad9f972,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:17.176291 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aab3e6b-5d78-4562-be3c-291143f2f6d5 None None] Network b79535bc-1164-4d3a-bbe9-6176a19d036c requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:17.196231 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 93c3618c-4f4c-42ad-9e08-086de4fab231 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:17.196608 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.249420 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.299268 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-b06a96e7-c62e-486d-87c4-f541e6d4c0b8 None None] Provisioning complete for port 18838d54-2a88-461c-8662-98ba7ad9f972 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:17.299875 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b06a96e7-c62e-486d-87c4-f541e6d4c0b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.466477 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] For port 1e2f4993-ec18-42fa-8228-1bee6190ecb5, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:17.474426 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] For port 1e2f4993-ec18-42fa-8228-1bee6190ecb5, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=1e2f4993-ec18-42fa-8228-1bee6190ecb5,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:17.477764 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Router f7404732-3a06-4890-aa0d-eeb65e2af688 is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101898) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:20:17.502024 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.578978 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9665d0-6be3-47cc-8506-1b3257893df6 req-6a37ee4c-22a0-4de3-ae90-3cc336890fa6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:17.581890 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5a9665d0-6be3-47cc-8506-1b3257893df6 req-6a37ee4c-22a0-4de3-ae90-3cc336890fa6 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 946 time: 0.1032021 Nov 16 03:20:17.723276 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5a9665d0-6be3-47cc-8506-1b3257893df6 req-342ab12a-0c97-4e93-a832-60b3cb45b7cb tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311088 Nov 16 03:20:17.774493 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b216fa-f9de-4b31-9ab7-842780757722 req-c7d9b7a4-dc66-4fb7-92ab-85fadb885e1c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:17.777012 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e6b216fa-f9de-4b31-9ab7-842780757722 req-c7d9b7a4-dc66-4fb7-92ab-85fadb885e1c tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.1155350 Nov 16 03:20:17.836177 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:17.844213 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e6b216fa-f9de-4b31-9ab7-842780757722 req-ba4c2a03-0f55-4a50-b53a-57bbe022e482 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542789 Nov 16 03:20:17.850116 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Sync routers for ids ['f7404732-3a06-4890-aa0d-eeb65e2af688'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:17.885623 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:17.885623 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-49268c8a-669b-4bed-ab46-d07b93a5487b admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.1286166 Nov 16 03:20:17.889265 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46398) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:17.895087 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Routers {'f7404732-3a06-4890-aa0d-eeb65e2af688'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:17.896226 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:19:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f7404732-3a06-4890-aa0d-eeb65e2af688'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:17.928776 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79789119-91c4-4d6d-9e77-6d92af6269fe None None] Pushing event updated for resources: {'Port': ['ID=1e2f4993-ec18-42fa-8228-1bee6190ecb5,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:17.967820 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:15Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:18.022657 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec8fb416-7fc3-442a-a073-644afe5247b2 None None] The sync data for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi is: [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:15Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:18.051905 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Set router f7404732-3a06-4890-aa0d-eeb65e2af688 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:18.467668 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-220ba946-1ca8-460f-89d2-78bc4af2ef60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:18.490430 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 3, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:18.526173 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Checking router: f7404732-3a06-4890-aa0d-eeb65e2af688 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:18.526493 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Updating router f7404732-3a06-4890-aa0d-eeb65e2af688 port 0b1cf2da-edeb-4070-b40d-fbc30d8735db binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:20:18.571923 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:18.653755 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 1e2f4993-ec18-42fa-8228-1bee6190ecb5 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:18.732743 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:18.732743 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:18.857560 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:18.898465 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:18.992224 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 1e2f4993-ec18-42fa-8228-1bee6190ecb5, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=1e2f4993-ec18-42fa-8228-1bee6190ecb5,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:19.003011 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.004446 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 18838d54-2a88-461c-8662-98ba7ad9f972 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:19.247187 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=1e2f4993-ec18-42fa-8228-1bee6190ecb5,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:19.248750 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-a906b3e8-84ab-4f76-b52d-2057e37f400e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:19.250439 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-a906b3e8-84ab-4f76-b52d-2057e37f400e tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.3035243 Nov 16 03:20:19.286830 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.303618 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 18838d54-2a88-461c-8662-98ba7ad9f972 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:19.304194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.304913 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.363534 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36888bd9-39cd-4b51-a0d9-5c9b5e709502 req-957a01c4-b80a-45fb-a3a3-d3c93b5ebec9 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:19.373578 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-36888bd9-39cd-4b51-a0d9-5c9b5e709502 req-957a01c4-b80a-45fb-a3a3-d3c93b5ebec9 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 946 time: 0.5272417 Nov 16 03:20:19.469483 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Attempting to bind port 0b1cf2da-edeb-4070-b40d-fbc30d8735db on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:19.472752 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Attempting to bind port 0b1cf2da-edeb-4070-b40d-fbc30d8735db by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:19.473205 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Attempting to bind port 0b1cf2da-edeb-4070-b40d-fbc30d8735db on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:19.481529 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5cf03e-94d7-4f1f-ac37-1412d2ab1133 None None] Pushing event updated for resources: {'Port': ['ID=0b1cf2da-edeb-4070-b40d-fbc30d8735db,revision_number=2']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:19.487240 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 19, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:19.487733 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:19.488431 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.488904 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:19.489673 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Bound port: 0b1cf2da-edeb-4070-b40d-fbc30d8735db, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:19.490148 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.513960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea3fb05b-992c-47f6-a357-ac08957cc56b req-c7987657-6fd4-4802-a054-ffe5949bf002 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:19.531378 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ea3fb05b-992c-47f6-a357-ac08957cc56b req-c7987657-6fd4-4802-a054-ffe5949bf002 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 946 time: 0.4483550 Nov 16 03:20:19.594059 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-584fdbd9-2f5f-439f-9da9-79dcb9d03f76 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:19.596706 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-584fdbd9-2f5f-439f-9da9-79dcb9d03f76 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "GET /v2.0/ports?device_id=b88a542c-0928-49cd-81c8-e95440adc731 HTTP/1.1" status: 200 len: 946 time: 0.1304133 Nov 16 03:20:19.609828 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] For port 0b1cf2da-edeb-4070-b40d-fbc30d8735db, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:19.616288 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] For port 0b1cf2da-edeb-4070-b40d-fbc30d8735db, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=0b1cf2da-edeb-4070-b40d-fbc30d8735db,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:19.631835 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.717861 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e4787a3-e4d3-42d8-8cc1-e878a65f5339 None None] Network 9718c5ed-4646-4da1-b02e-63257534ec52 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:19.763154 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Routers {'f7404732-3a06-4890-aa0d-eeb65e2af688'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:19.763864 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f7404732-3a06-4890-aa0d-eeb65e2af688'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:19.766266 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5cf03e-94d7-4f1f-ac37-1412d2ab1133 None None] Pushing event updated for resources: {'Port': ['ID=0b1cf2da-edeb-4070-b40d-fbc30d8735db,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:19.770941 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-36888bd9-39cd-4b51-a0d9-5c9b5e709502 req-cf1c3647-7298-488c-919d-128e860538f0 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.31 "GET /v2.0/security-groups?id=22454019-d259-4e06-9dc4-92c4c9c77f03&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3958485 Nov 16 03:20:19.878370 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ea3fb05b-992c-47f6-a357-ac08957cc56b req-6f962b5d-c0b7-4351-8d16-fd39af7014b1 tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/security-groups?id=d59f1128-96e8-4a12-a73b-25548af67b95&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3457460 Nov 16 03:20:19.887075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Deleting port f7e69534-b12b-41e4-b78d-014ae8dee4db {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:19.887603 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:19.927872 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Deleting port c7ca7b87-66b6-45ce-9656-e62a40792408 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:19.928551 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.044961 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.064295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-5b1d1906-a96a-4127-8d84-526cb682a88a None None] Provisioning complete for port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:20.064800 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5b1d1906-a96a-4127-8d84-526cb682a88a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.160398 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] Set router f7404732-3a06-4890-aa0d-eeb65e2af688 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:20.279818 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] For port f7e69534-b12b-41e4-b78d-014ae8dee4db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f7e69534-b12b-41e4-b78d-014ae8dee4db,segment=NetworkSegment(494aff95-079c-4b92-b4fa-97068bf0b02b),segment_id=494aff95-079c-4b92-b4fa-97068bf0b02b)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:20.280899 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.312055 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Calling delete_port for f7e69534-b12b-41e4-b78d-014ae8dee4db owned by compute:nova {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:20.402071 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] For port c7ca7b87-66b6-45ce-9656-e62a40792408, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c7ca7b87-66b6-45ce-9656-e62a40792408,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:20.402766 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.498006 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 3, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:20.518329 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 1e2f4993-ec18-42fa-8228-1bee6190ecb5 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:20.522717 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Calling delete_port for c7ca7b87-66b6-45ce-9656-e62a40792408 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:20.526007 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Allocated IP 172.20.0.1 (9718c5ed-4646-4da1-b02e-63257534ec52/d0585411-56ad-49f6-aff5-68e4e82ba7bd/9e3470c9-1e02-43ea-b495-8bf9b1bb7ece) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:20.602095 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-f293c1f2-a4cf-44b9-8471-399f5ec33931 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1557299526&fields=id&tenant_id=f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 267 time: 0.4544799 Nov 16 03:20:20.609618 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2305f562-e0b1-4af4-856f-bc01bb65f9fc None None] The sync data for ids ['f7404732-3a06-4890-aa0d-eeb65e2af688'] in dv-cinder-818037-1-iscsi is: [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 3, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:20.677076 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:20.678385 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.751219 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.798890 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['f7e69534-b12b-41e4-b78d-014ae8dee4db'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:20.835767 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-7bfb6de3-44bc-4f4f-8865-2659fad5e28d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:20.837409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-7bfb6de3-44bc-4f4f-8865-2659fad5e28d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 813 time: 0.6926439 Nov 16 03:20:20.850847 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Pushing event deleted for resources: {'Port': ['ID=f7e69534-b12b-41e4-b78d-014ae8dee4db,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:20.875869 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-1a1dfbf9-54c7-44e6-a305-854a1f665650 None None] Provisioning complete for port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:20.876469 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1a1dfbf9-54c7-44e6-a305-854a1f665650 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.921116 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-2da17438-86c0-4093-b165-bc180c6204bf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/quotas/ec26dd4c49f74ef7b1b41c9d379e7aa6 HTTP/1.1" status: 200 len: 375 time: 0.0605838 Nov 16 03:20:20.942279 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-4b56ab87-dc65-4c32-9306-7437e41e4b70 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:20.949704 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-4b56ab87-dc65-4c32-9306-7437e41e4b70 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 812 time: 0.3461521 Nov 16 03:20:20.959616 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.965837 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] No DVR routers for this DVR port f7e69534-b12b-41e4-b78d-014ae8dee4db on host hv-cinder-81803 {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:20:20.969736 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:20.974714 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-d31db0fa-0691-4734-9e6e-897506fde1bf req-731dc64f-ceea-465f-977f-7ee4fae30743 tempest-AttachVolumeNegativeTest-1152868863 tempest-AttachVolumeNegativeTest-1152868863-project] 10.222.0.11 "DELETE /v2.0/ports/f7e69534-b12b-41e4-b78d-014ae8dee4db HTTP/1.1" status: 204 len: 173 time: 1.3695025 Nov 16 03:20:20.974976 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b88a542c-0928-49cd-81c8-e95440adc731', 'name': 'network-vif-deleted', 'tag': 'f7e69534-b12b-41e4-b78d-014ae8dee4db'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:20.988848 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5853c69-0fc1-4b24-97ce-025d7661831e" -d '{"events": [{"server_uuid": "b88a542c-0928-49cd-81c8-e95440adc731", "name": "network-vif-deleted", "tag": "f7e69534-b12b-41e4-b78d-014ae8dee4db"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:21.096156 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-2fe3016d-338a-4bb6-ada1-24affe55e866 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/quotas/f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 375 time: 0.1427739 Nov 16 03:20:21.109265 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-84c554b6-be72-44c0-bac3-ce6f51539ca1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1540618 Nov 16 03:20:21.492629 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:21.592539 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:21.621337 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:21.692109 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-6ac74d96-1896-4e5d-a367-daecc884b3b7 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5944076 Nov 16 03:20:21.693904 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:21.697625 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Pushing event deleted for resources: {'Port': ['ID=c7ca7b87-66b6-45ce-9656-e62a40792408,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:21.794820 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-bb4dbb72-87e3-4b71-b66b-a57488057382 service neutron] 10.222.0.31 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6644499 Nov 16 03:20:21.848421 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Network 9718c5ed-4646-4da1-b02e-63257534ec52 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:21.891578 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:21.953202 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] No DVR routers for this DVR port c7ca7b87-66b6-45ce-9656-e62a40792408 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:20:21.959211 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:21.969303 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:21.975889 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5efa40b4-39f8-414b-823e-8ab349fcb483 req-3c764f19-aba4-4ef3-9c96-5210709ad2ef tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.11 "DELETE /v2.0/ports/c7ca7b87-66b6-45ce-9656-e62a40792408 HTTP/1.1" status: 204 len: 173 time: 2.7095263 Nov 16 03:20:21.978491 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Pushing event updated for resources: {'Port': ['ID=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:21.981581 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41418e21-082d-437e-acdd-7219a2790fcc', 'name': 'network-vif-deleted', 'tag': 'c7ca7b87-66b6-45ce-9656-e62a40792408'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:21.985407 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fea90f0-541a-4512-ab8d-a4739842bdec" -d '{"events": [{"server_uuid": "41418e21-082d-437e-acdd-7219a2790fcc", "name": "network-vif-deleted", "tag": "c7ca7b87-66b6-45ce-9656-e62a40792408"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:22.106823 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:22.117599 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-35eb50f3-0177-4f68-b8ba-7ab113fdb054 service neutron] 10.222.0.31 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3563299 Nov 16 03:20:22.228830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-a5d5b393-2b70-4d14-ae56-4744963138e9 None None] Provisioning complete for port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:22.229760 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a5d5b393-2b70-4d14-ae56-4744963138e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:22.270956 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-dfcee75f-154f-44ea-a272-64dc720c6a1d service neutron] 10.222.0.31 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4582503 Nov 16 03:20:22.294295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-a5d5b393-2b70-4d14-ae56-4744963138e9 None None] Port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:22.353708 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-66067fd8-33a2-41f8-96c2-b4b5df107e21 service neutron] 10.222.0.31 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1803968 Nov 16 03:20:22.404571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:22.537348 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46440) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:22.785418 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 0b1cf2da-edeb-4070-b40d-fbc30d8735db up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:22.809157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Deleting subnet a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:20:22.832874 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:22.867781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:22.944922 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7d68ecc-1135-47d4-9cec-1d00d58961a8 req-f0beb510-81f6-40ca-9642-dfae03f0716b tempest-ServerRescueNegativeTestJSON-185801790 tempest-ServerRescueNegativeTestJSON-185801790-project] 10.222.0.31 "GET /v2.0/ports?device_id=41418e21-082d-437e-acdd-7219a2790fcc HTTP/1.1" status: 200 len: 210 time: 0.0725069 Nov 16 03:20:22.946730 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:22.997006 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 0b1cf2da-edeb-4070-b40d-fbc30d8735db triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:23.000287 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.066894 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.116065 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Pushing event updated for resources: {'Port': ['ID=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:23.144983 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c7ca7b87-66b6-45ce-9656-e62a40792408 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:23.174485 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c668521-b080-49e4-823d-c2ed4b063fe1 x-openstack-request-id: req-4c668521-b080-49e4-823d-c2ed4b063fe1 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:23.174816 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.177485 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b88a542c-0928-49cd-81c8-e95440adc731", "name": "network-vif-deleted", "tag": "f7e69534-b12b-41e4-b78d-014ae8dee4db", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:23.178844 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-4c668521-b080-49e4-823d-c2ed4b063fe1 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:23.179816 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b88a542c-0928-49cd-81c8-e95440adc731', 'name': 'network-vif-deleted', 'tag': 'f7e69534-b12b-41e4-b78d-014ae8dee4db', 'status': 'completed', 'code': 200} Nov 16 03:20:23.189224 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7bdccfee-7aaf-436a-bc7a-2a018421058d x-openstack-request-id: req-7bdccfee-7aaf-436a-bc7a-2a018421058d {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:23.189560 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41418e21-082d-437e-acdd-7219a2790fcc", "name": "network-vif-deleted", "tag": "c7ca7b87-66b6-45ce-9656-e62a40792408", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:23.190033 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-7bdccfee-7aaf-436a-bc7a-2a018421058d {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:23.191003 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41418e21-082d-437e-acdd-7219a2790fcc', 'name': 'network-vif-deleted', 'tag': 'c7ca7b87-66b6-45ce-9656-e62a40792408', 'status': 'completed', 'code': 200} Nov 16 03:20:23.194883 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: c7ca7b87-66b6-45ce-9656-e62a40792408 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:23.196075 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c7ca7b87-66b6-45ce-9656-e62a40792408 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:23.202487 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device f7e69534-b12b-41e4-b78d-014ae8dee4db no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:23.282855 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.295749 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: f7e69534-b12b-41e4-b78d-014ae8dee4db {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:23.296626 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device f7e69534-b12b-41e4-b78d-014ae8dee4db not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:23.431438 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.466862 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-21280f32-4019-438b-b5f1-5f390e71bd68 req-bcf1cc07-a7a1-4b93-b320-fcd2929b06f3 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 210 time: 0.1128159 Nov 16 03:20:23.470108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 0b1cf2da-edeb-4070-b40d-fbc30d8735db, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=0b1cf2da-edeb-4070-b40d-fbc30d8735db,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:23.478484 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.481774 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc119511-e3cf-4e54-bc4d-cfac10861e0b req-d98f0bdb-2447-4bdc-8253-a3da6913236d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.1115766 Nov 16 03:20:23.527547 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.603903 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a3fb04df-83c0-4d51-afa7-1e0694c8dbc3,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:23.609500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.616596 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-fe3801e2-0b09-49f9-92a7-86ea62c400d7 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/a3fb04df-83c0-4d51-afa7-1e0694c8dbc3 HTTP/1.1" status: 204 len: 168 time: 1.0729778 Nov 16 03:20:23.627467 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46458) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:23.638482 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=0b1cf2da-edeb-4070-b40d-fbc30d8735db,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:23.669996 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Network 9718c5ed-4646-4da1-b02e-63257534ec52 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:23.704879 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:23.870183 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:23.995772 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Router f7404732-3a06-4890-aa0d-eeb65e2af688 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:20:24.012320 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.044400 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a8436ad-09c6-4a61-8922-e3cc29d73f78']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:24.088007 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46468) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:24.131797 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '494aff95-079c-4b92-b4fa-97068bf0b02b') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:24.132650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '494aff95-079c-4b92-b4fa-97068bf0b02b') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:24.152272 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.185383 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.186160 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-20511cb5-e308-4ff5-960e-4798e7e0268b None None] Provisioning complete for port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:24.188018 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-20511cb5-e308-4ff5-960e-4798e7e0268b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.201220 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Releasing vlan 327 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:20:24.201784 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:20:24.203622 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:20:24.261681 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-20511cb5-e308-4ff5-960e-4798e7e0268b None None] Port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:24.274895 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:24.293072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Sync routers for ids ['f7404732-3a06-4890-aa0d-eeb65e2af688'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:24.295044 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-65f81e0f-e9df-40c4-93fd-a92f3fcd4930 admin admin] 10.222.0.31 "PUT /v2.0/routers/f7404732-3a06-4890-aa0d-eeb65e2af688/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4038224 Nov 16 03:20:24.314566 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.328446 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.344534 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] 10.222.0.31 "DELETE /v2.0/networks/9a8436ad-09c6-4a61-8922-e3cc29d73f78 HTTP/1.1" status: 204 len: 168 time: 0.7128656 Nov 16 03:20:24.361580 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Routers {'f7404732-3a06-4890-aa0d-eeb65e2af688'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:24.363557 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6dcccf6-3ad0-45eb-9272-e5620c644d9c admin admin] Pushing event deleted for resources: {'Network': ['ID=9a8436ad-09c6-4a61-8922-e3cc29d73f78,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:24.364828 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f7404732-3a06-4890-aa0d-eeb65e2af688'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:24.558802 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 0b1cf2da-edeb-4070-b40d-fbc30d8735db up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:24.580884 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Set router f7404732-3a06-4890-aa0d-eeb65e2af688 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:24.632843 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46484) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:24.730985 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 0b1cf2da-edeb-4070-b40d-fbc30d8735db triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:24.731363 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:24.751901 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a68d2a76-ad20-4b15-9281-c8b948478e0e req-0d1793ba-773b-4b9e-8368-6baca7e20b40 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 210 time: 0.0777442 Nov 16 03:20:24.779920 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b73f18ff-8777-4087-9b59-0cf76db46e8d req-b241d383-5a51-43e3-b02a-7133433d0603 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0716076 Nov 16 03:20:24.787969 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-cb9406ed-f61a-44fe-a059-f8e4281c8bb7 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=61a2e084639344ff8e8d5ade2eef51d0&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1526144 Nov 16 03:20:24.792801 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46486) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:25.046333 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eeeffe14-cb95-474d-b245-496164fc75c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.104147 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:20:22Z', 'revision_number': 4, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '9e3470c9-1e02-43ea-b495-8bf9b1bb7ece', 'name': '', 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'mac_address': 'fa:16:3e:8a:b7:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_interface', 'standard_attr_id': 491, 'fixed_ips': [{'subnet_id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:19Z', 'updated_at': '2021-11-16T03:20:22Z', 'revision_number': 2, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'subnets': [{'id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:25.143962 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Checking router: f7404732-3a06-4890-aa0d-eeb65e2af688 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:25.144911 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Updating router f7404732-3a06-4890-aa0d-eeb65e2af688 port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:20:25.174953 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.264724 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eeeffe14-cb95-474d-b245-496164fc75c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.326017 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.496697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-b3daf35a-45ee-40da-8373-95a941e4a048 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:25.501097 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-b3daf35a-45ee-40da-8373-95a941e4a048 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 813 time: 0.5063412 Nov 16 03:20:25.517920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eeeffe14-cb95-474d-b245-496164fc75c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.522395 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-eeeffe14-cb95-474d-b245-496164fc75c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.523940 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-eeeffe14-cb95-474d-b245-496164fc75c9 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/22454019-d259-4e06-9dc4-92c4c9c77f03 HTTP/1.1" status: 204 len: 168 time: 0.7240305 Nov 16 03:20:25.538934 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeeffe14-cb95-474d-b245-496164fc75c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22454019-d259-4e06-9dc4-92c4c9c77f03,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:25.560509 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Request body: {'port': {'device_id': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c', 'admin_state_up': True, 'tenant_id': 'ec26dd4c49f74ef7b1b41c9d379e7aa6'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:25.836868 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Made reservation on behalf of ec26dd4c49f74ef7b1b41c9d379e7aa6 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:25.851120 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.928190 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:25.942850 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.099616 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cabed2-440f-4648-b512-de8a3845a04d None None] Pushing event updated for resources: {'Port': ['ID=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:26.103546 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b7b6c3fc-563f-4b70-ab21-746e40159ab8 req-61a160c8-7291-40ca-8da2-2f5bfe2fdb09 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 210 time: 0.0610511 Nov 16 03:20:26.149685 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bfa56a8a-5111-4810-8d50-0ab58ac86b35 req-96bdd54d-f5e8-4d22-a370-089eab6a66c9 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.1086907 Nov 16 03:20:26.257234 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Attempting to bind port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:26.257890 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Attempting to bind port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:26.260720 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-94331050-4c9d-462d-a548-f86bd8fd01da tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:26.262069 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Attempting to bind port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece on network 9718c5ed-4646-4da1-b02e-63257534ec52 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:26.265182 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-94331050-4c9d-462d-a548-f86bd8fd01da tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 812 time: 0.5859475 Nov 16 03:20:26.265908 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Allocated IP 172.20.0.8 (b79535bc-1164-4d3a-bbe9-6176a19d036c/eb17dc2c-fa73-481e-b845-85a7c8e8df27/28525ffc-1c38-4068-bbad-deeb2fb7501b) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:26.273240 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:26.279117 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Checking segment: {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:26.286706 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.287623 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Bound using segment: {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:26.289368 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Bound port: 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:26.290242 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.431089 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Deleting port a9dd54a6-2e04-4400-93de-25f6cdedcfd0 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:26.431698 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.459812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] For port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:26.467935 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] For port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:26.479873 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.608059 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-54d06a45-aa48-47a0-8264-c9e790a2708d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 380 time: 0.3253088 Nov 16 03:20:26.631407 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'port': {'device_id': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'admin_state_up': True, 'tenant_id': 'f0e656658949487fb898565d34636908', 'security_groups': ['b3b2cefa-a732-4c2d-8879-25a8537d518a']}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:26.632158 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.729080 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.816555 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Routers {'f7404732-3a06-4890-aa0d-eeb65e2af688'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:26.826387 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f7404732-3a06-4890-aa0d-eeb65e2af688'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:26.840857 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cabed2-440f-4648-b512-de8a3845a04d None None] Pushing event updated for resources: {'Port': ['ID=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:26.919466 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Pushing event updated for resources: {'Port': ['ID=28525ffc-1c38-4068-bbad-deeb2fb7501b,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:26.930734 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-04430b7a-5195-4f8f-97bc-88865bb97b84 None None] Provisioning complete for port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:26.931554 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04430b7a-5195-4f8f-97bc-88865bb97b84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:26.948324 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Network b79535bc-1164-4d3a-bbe9-6176a19d036c is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:26.954273 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:26.957318 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:26.994516 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] For port a9dd54a6-2e04-4400-93de-25f6cdedcfd0, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,segment=NetworkSegment(d61b296a-1685-4eef-8945-c92743196c72),segment_id=d61b296a-1685-4eef-8945-c92743196c72)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:26.995088 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.020401 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Made reservation on behalf of f0e656658949487fb898565d34636908 for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:27.030200 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.107707 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:27.108826 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.153098 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Calling delete_port for a9dd54a6-2e04-4400-93de-25f6cdedcfd0 owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:27.216724 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-341a2e77-1f49-45b1-b83b-ff3814883e9e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6792009 Nov 16 03:20:27.219526 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] Set router f7404732-3a06-4890-aa0d-eeb65e2af688 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:27.239954 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Request body: {'port': {'device_id': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:27.341611 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04430b7a-5195-4f8f-97bc-88865bb97b84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.353099 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Allocated IP 172.20.0.4 (47ea8a48-7e03-48bf-883e-ab437cbcd3a0/5adb8701-919b-407f-b696-94dbe3d5e70a/708ca4dc-7d1f-4191-b1d2-fe81df173fc1) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:27.386989 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-30e1cef9-3a35-4087-89fa-1968d00907bb req-bb9f38cd-a78b-498b-9aed-f595670a20f1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0865998 Nov 16 03:20:27.537345 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.585761 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c2a6a6-a27f-4639-9aa6-067bdb3b98cd req-34093ff3-9543-45e3-b2bc-648359fe0ced tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:27.589692 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-24c2a6a6-a27f-4639-9aa6-067bdb3b98cd req-34093ff3-9543-45e3-b2bc-648359fe0ced tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 931 time: 0.1983688 Nov 16 03:20:27.655691 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-04430b7a-5195-4f8f-97bc-88865bb97b84 None None] For port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:27.669483 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.680687 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04430b7a-5195-4f8f-97bc-88865bb97b84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.727196 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.790229 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:27.797387 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:27.808653 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:27.880174 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:27.909854 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8c9af44f-ea47-4fe9-90ce-60b7693c8d6a None None] Provisioning complete for port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:27.911418 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8c9af44f-ea47-4fe9-90ce-60b7693c8d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.963851 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:27.964533 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:27.974993 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04430b7a-5195-4f8f-97bc-88865bb97b84 None None] Pushing event updated for resources: {'Port': ['ID=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:28.003106 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8a8818d3-2ff8-43bb-867a-14400674544e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3764477 Nov 16 03:20:28.005017 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:28.006693 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-24c2a6a6-a27f-4639-9aa6-067bdb3b98cd req-8c93d84c-6b08-402a-bc1e-82b94b4206eb tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3720920 Nov 16 03:20:28.126961 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Request body: {'port': {'device_id': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:28.166572 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:20:22Z', 'revision_number': 4, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '9e3470c9-1e02-43ea-b495-8bf9b1bb7ece', 'name': '', 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'mac_address': 'fa:16:3e:8a:b7:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_interface', 'standard_attr_id': 491, 'fixed_ips': [{'subnet_id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:19Z', 'updated_at': '2021-11-16T03:20:26Z', 'revision_number': 4, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'subnets': [{'id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:28.215738 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764cafbe-a45c-40c5-a881-b83399908799 None None] The sync data for ids ['f7404732-3a06-4890-aa0d-eeb65e2af688'] in dv-cinder-818037-1-iscsi is: [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:20:22Z', 'revision_number': 4, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '9e3470c9-1e02-43ea-b495-8bf9b1bb7ece', 'name': '', 'network_id': '9718c5ed-4646-4da1-b02e-63257534ec52', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'mac_address': 'fa:16:3e:8a:b7:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_interface', 'standard_attr_id': 491, 'fixed_ips': [{'subnet_id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:19Z', 'updated_at': '2021-11-16T03:20:26Z', 'revision_number': 4, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'subnets': [{'id': 'd0585411-56ad-49f6-aff5-68e4e82ba7bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:28.263105 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:28.376660 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-7291da9c-c5ee-450c-802e-e6370f60b1a3 None None] Provisioning complete for port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:28.377450 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7291da9c-c5ee-450c-802e-e6370f60b1a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:28.415371 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Pushing event deleted for resources: {'Port': ['ID=a9dd54a6-2e04-4400-93de-25f6cdedcfd0,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:28.454832 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 28525ffc-1c38-4068-bbad-deeb2fb7501b {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:20:28.464803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:28.480721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Transition to ACTIVE for port object 28525ffc-1c38-4068-bbad-deeb2fb7501b will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:20:28.491190 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:28.565828 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-7291da9c-c5ee-450c-802e-e6370f60b1a3 None None] Port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:28.740574 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Pushing event updated for resources: {'Port': ['ID=28525ffc-1c38-4068-bbad-deeb2fb7501b,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:28.839558 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:28.965210 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:28.965749 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:29.137624 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:29.294548 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:20:29.320801 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:29.357244 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Transition to ACTIVE for port object 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:20:29.378001 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:29.601016 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8824da12-7257-41be-baf7-b0b5b5cd1849 req-51650ba3-d851-4ec8-b215-206ae3e06470 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:29.603996 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8824da12-7257-41be-baf7-b0b5b5cd1849 req-51650ba3-d851-4ec8-b215-206ae3e06470 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 931 time: 0.9114566 Nov 16 03:20:29.624435 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9608ebc0-960d-478f-8933-082f14f13981 req-894d963e-36cb-4bda-9728-35baeda8130b tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:29.646268 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9608ebc0-960d-478f-8933-082f14f13981 req-894d963e-36cb-4bda-9728-35baeda8130b tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 943 time: 0.3435650 Nov 16 03:20:29.651094 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Attempting to bind port 28525ffc-1c38-4068-bbad-deeb2fb7501b on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:29.651485 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Attempting to bind port 28525ffc-1c38-4068-bbad-deeb2fb7501b by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:29.651974 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Attempting to bind port 28525ffc-1c38-4068-bbad-deeb2fb7501b on network b79535bc-1164-4d3a-bbe9-6176a19d036c {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:29.684366 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Port 28525ffc-1c38-4068-bbad-deeb2fb7501b on network b79535bc-1164-4d3a-bbe9-6176a19d036c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:20:29.685011 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Attempting to bind port 28525ffc-1c38-4068-bbad-deeb2fb7501b on network b79535bc-1164-4d3a-bbe9-6176a19d036c {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:29.735317 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:29.740245 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Checking segment: {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:29.741130 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Bound using segment: {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:29.741869 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Bound port: 28525ffc-1c38-4068-bbad-deeb2fb7501b, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:29.742429 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:29.978275 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8824da12-7257-41be-baf7-b0b5b5cd1849 req-aedc5062-38bf-4bf5-8831-82a82fdf8e48 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2956662 Nov 16 03:20:30.001082 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9608ebc0-960d-478f-8933-082f14f13981 req-428e4409-360c-44d3-b47a-b7c53a3748aa tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3207235 Nov 16 03:20:30.007764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] For port 28525ffc-1c38-4068-bbad-deeb2fb7501b, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:30.019179 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] For port 28525ffc-1c38-4068-bbad-deeb2fb7501b, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:30.029225 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:30.055616 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Pushing event updated for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:30.089031 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:30.089848 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:30.091513 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] 10.222.0.11 "PUT /v2.0/ports/28525ffc-1c38-4068-bbad-deeb2fb7501b HTTP/1.1" status: 200 len: 1093 time: 2.8601496 Nov 16 03:20:30.092111 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'tag': '28525ffc-1c38-4068-bbad-deeb2fb7501b'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:30.094636 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44d8fc84-988d-4c52-af96-efc5d2a8f58c" -d '{"events": [{"name": "network-changed", "server_uuid": "5ed5ed50-c2a1-47a7-a744-23b6c614cfa4", "tag": "28525ffc-1c38-4068-bbad-deeb2fb7501b"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:30.154586 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44aac0df-eadb-4cc4-b431-74e9f890b5e1 service neutron] Pushing event updated for resources: {'Port': ['ID=28525ffc-1c38-4068-bbad-deeb2fb7501b,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:30.245821 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9675103b-64e5-4741-9c3a-652f000fea63 x-openstack-request-id: req-9675103b-64e5-4741-9c3a-652f000fea63 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:30.246113 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ed5ed50-c2a1-47a7-a744-23b6c614cfa4", "tag": "28525ffc-1c38-4068-bbad-deeb2fb7501b", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:30.246416 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9675103b-64e5-4741-9c3a-652f000fea63 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:30.246821 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'tag': '28525ffc-1c38-4068-bbad-deeb2fb7501b', 'status': 'completed', 'code': 200} Nov 16 03:20:30.288643 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-881ba632-f46d-48b6-8541-c20ec8be1549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:30.293170 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-881ba632-f46d-48b6-8541-c20ec8be1549 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 1096 time: 0.1000922 Nov 16 03:20:30.357128 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Attempting to bind port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:30.358084 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Attempting to bind port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:30.358084 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Attempting to bind port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:30.385335 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:20:30.385906 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Attempting to bind port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:30.399291 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-7dbdb086-e561-467f-9119-8f6ed4912ecb service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b HTTP/1.1" status: 200 len: 217 time: 0.0802107 Nov 16 03:20:30.409195 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:30.409819 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Checking segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:30.410404 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Bound using segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:30.411086 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Bound port: 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:30.411613 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:30.478974 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Router fd8eae1b-2162-4723-a7c8-49cb2e850753 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:20:30.561189 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f6ff0-a5fe-4078-a736-5273899be654 req-55c0aa2f-abf1-488d-98a4-7d0f2e5b1d7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:30.563118 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-55c0aa2f-abf1-488d-98a4-7d0f2e5b1d7f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=eb17dc2c-fa73-481e-b845-85a7c8e8df27 HTTP/1.1" status: 200 len: 853 time: 0.1363177 Nov 16 03:20:30.652071 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-6b72203a-4351-40fa-b06d-1878fde518d5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b79535bc-1164-4d3a-bbe9-6176a19d036c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0816097 Nov 16 03:20:30.762845 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:30.776185 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2586d300-47b4-4480-b842-2176baca0534 admin admin] 10.222.0.31 "PUT /v2.0/routers/fd8eae1b-2162-4723-a7c8-49cb2e850753/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6876144 Nov 16 03:20:30.778959 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] Sync routers for ids ['fd8eae1b-2162-4723-a7c8-49cb2e850753'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:30.781329 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46566) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:30.806394 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] Routers {'fd8eae1b-2162-4723-a7c8-49cb2e850753'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:30.807354 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['fd8eae1b-2162-4723-a7c8-49cb2e850753'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:30.968217 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] Set router fd8eae1b-2162-4723-a7c8-49cb2e850753 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:30.995040 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-314891d4-eeb9-4d76-8c7b-625e503a24ec service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3340700 Nov 16 03:20:31.006174 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:31.041122 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:31.086042 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:31.274107 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:20:27Z', 'revision_number': 5, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:17:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:31.310207 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] Checking router: fd8eae1b-2162-4723-a7c8-49cb2e850753 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:31.325315 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:31.326768 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:31.330775 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] 10.222.0.11 "PUT /v2.0/ports/708ca4dc-7d1f-4191-b1d2-fe81df173fc1 HTTP/1.1" status: 200 len: 1093 time: 3.3074849 Nov 16 03:20:31.332230 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:31.336849 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42a147c7-54b3-43e8-8318-910f520de26d" -d '{"events": [{"name": "network-changed", "server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:31.344375 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] Routers {'fd8eae1b-2162-4723-a7c8-49cb2e850753'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:31.346680 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['fd8eae1b-2162-4723-a7c8-49cb2e850753'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:31.381580 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f549c7b-d588-4354-bdaa-b681f24197c5 req-0740fbb8-38e1-4beb-b8ae-fd5446d0d1ff tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:31.395312 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7f549c7b-d588-4354-bdaa-b681f24197c5 req-0740fbb8-38e1-4beb-b8ae-fd5446d0d1ff tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.2163916 Nov 16 03:20:31.431102 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4cc082-27e1-4598-b728-25e259a9dd80 service neutron] Pushing event updated for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:31.456558 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks [] for router, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:31.474213 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9680b8b4-18d3-4b19-b8fd-7ada5c56e4f7 req-9fb00e9e-d786-4c7c-9a71-2d371512699c tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:31.482173 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9680b8b4-18d3-4b19-b8fd-7ada5c56e4f7 req-9fb00e9e-d786-4c7c-9a71-2d371512699c tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 943 time: 0.2212951 Nov 16 03:20:31.494713 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-574f6ff0-a5fe-4078-a736-5273899be654 req-9e86764c-9154-4e5d-8e3c-697026d2f216 service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4846292 Nov 16 03:20:31.570615 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7f549c7b-d588-4354-bdaa-b681f24197c5 req-c2aa9cb1-7687-4cfc-8ecb-38ce09f5b278 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1686964 Nov 16 03:20:31.648610 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9680b8b4-18d3-4b19-b8fd-7ada5c56e4f7 req-cae07cfe-0710-4667-bcbf-c1a80701a1f4 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639702 Nov 16 03:20:31.652621 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] Set router fd8eae1b-2162-4723-a7c8-49cb2e850753 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:31.729963 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92adb6fc-5974-4795-a876-58ec19d35791 x-openstack-request-id: req-92adb6fc-5974-4795-a876-58ec19d35791 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:31.730576 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:31.731090 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-92adb6fc-5974-4795-a876-58ec19d35791 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:31.731804 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'status': 'completed', 'code': 200} Nov 16 03:20:31.785504 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:31.881961 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Deleting port 7f64383f-ace3-4b55-80d1-414d29eacb2f {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:20:31.882591 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:31.960489 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:20:27Z', 'revision_number': 5, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:17:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:32.002349 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2427aa3e-482c-4a5b-912e-237b375b87e8 None None] The sync data for ids ['fd8eae1b-2162-4723-a7c8-49cb2e850753'] in dv-cinder-818037-1-iscsi is: [{'id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'name': 'tempest-ServerRescueNegativeTestJSON-1625479272-router', 'tenant_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109'}], 'enable_snat': True}, 'gw_port_id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:16:55Z', 'updated_at': '2021-11-16T03:20:27Z', 'revision_number': 5, 'project_id': 'e487df53678d4cd890ccf9e6c950fa5e', 'gw_port': {'id': '7f64383f-ace3-4b55-80d1-414d29eacb2f', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:7a:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd8eae1b-2162-4723-a7c8-49cb2e850753', 'device_owner': 'network:router_gateway', 'standard_attr_id': 56, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:16:56Z', 'updated_at': '2021-11-16T03:17:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:32.028027 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] For port 7f64383f-ace3-4b55-80d1-414d29eacb2f, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=7f64383f-ace3-4b55-80d1-414d29eacb2f,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:32.028467 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.046078 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Calling delete_port for 7f64383f-ace3-4b55-80d1-414d29eacb2f owned by network:router_gateway {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:20:32.286104 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.315134 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Pushing event deleted for resources: {'Port': ['ID=7f64383f-ace3-4b55-80d1-414d29eacb2f,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:32.416882 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.549072 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.552687 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.564921 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a9dd54a6-2e04-4400-93de-25f6cdedcfd0 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:32.630285 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: a9dd54a6-2e04-4400-93de-25f6cdedcfd0 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:32.637830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a9dd54a6-2e04-4400-93de-25f6cdedcfd0 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:32.704367 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.704941 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Fanout notify agent at l3_agent the message router_deleted on router fd8eae1b-2162-4723-a7c8-49cb2e850753 {{(pid=101898) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:20:32.716360 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.722532 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-46e6695e-d85f-4b9d-9ba1-826750d82eac admin admin] 10.222.0.31 "DELETE /v2.0/routers/fd8eae1b-2162-4723-a7c8-49cb2e850753 HTTP/1.1" status: 204 len: 168 time: 1.9343562 Nov 16 03:20:32.724170 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46592) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:32.839787 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Deleting subnet d29e78fd-50ef-4647-88a4-83b1f418a6b5 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:20:32.844880 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:32.874047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ad15a2-cb93-422d-b8f2-7252f754ffb8 req-f1a12665-ee7e-4e51-b374-525603ab7b9c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:32.889126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d3ad15a2-cb93-422d-b8f2-7252f754ffb8 req-f1a12665-ee7e-4e51-b374-525603ab7b9c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.1835680 Nov 16 03:20:32.919761 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.035086 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.050222 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d3ad15a2-cb93-422d-b8f2-7252f754ffb8 req-f526b9ac-d3ee-4b11-9a39-087192905c10 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1590593 Nov 16 03:20:33.096592 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef58941-f3a5-4760-99d0-eb14298ddba3 req-62907e16-f90d-4239-9986-aab947a80d39 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:33.098511 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fef58941-f3a5-4760-99d0-eb14298ddba3 req-62907e16-f90d-4239-9986-aab947a80d39 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 943 time: 0.1983995 Nov 16 03:20:33.157744 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.185203 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fef58941-f3a5-4760-99d0-eb14298ddba3 req-7bda6f6e-d8d5-41cd-b4ef-cc0e16d7ca52 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767677 Nov 16 03:20:33.226852 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.234948 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/d29e78fd-50ef-4647-88a4-83b1f418a6b5 HTTP/1.1" status: 204 len: 168 time: 0.5094481 Nov 16 03:20:33.236583 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2573aeb-3d3f-48c5-a682-57a9f8a3b336 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d29e78fd-50ef-4647-88a4-83b1f418a6b5,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:33.239442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46594) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:33.375538 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.494833 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.531253 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b8800875-2e98-4cb6-a3a9-9d5ee637458a']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:33.550275 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd61b296a-1685-4eef-8945-c92743196c72') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:33.550655 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd61b296a-1685-4eef-8945-c92743196c72') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:33.563752 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.585730 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.595332 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Releasing vlan 331 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:20:33.595796 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:20:33.598886 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:20:33.704429 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.719966 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:33.724772 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] 10.222.0.31 "DELETE /v2.0/networks/b8800875-2e98-4cb6-a3a9-9d5ee637458a HTTP/1.1" status: 204 len: 168 time: 0.4838431 Nov 16 03:20:33.739858 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05d7a08-d54d-4a1e-af8e-8225c6edb545 admin admin] Pushing event deleted for resources: {'Network': ['ID=b8800875-2e98-4cb6-a3a9-9d5ee637458a,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:33.897170 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-0da46959-f9c9-4918-abf9-0b410256ccea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:33.901168 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-0da46959-f9c9-4918-abf9-0b410256ccea service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 1096 time: 0.1074784 Nov 16 03:20:34.004548 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a147c7-54b3-43e8-8318-910f520de26d req-34e50de4-4d79-4e05-979b-8d19365552af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.013001 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-42a147c7-54b3-43e8-8318-910f520de26d req-34e50de4-4d79-4e05-979b-8d19365552af service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1096 time: 0.1374846 Nov 16 03:20:34.078564 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46606) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:34.183100 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b8f344a5-0ff5-4cbf-aac9-b7d64c0502ad admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e487df53678d4cd890ccf9e6c950fa5e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0983469 Nov 16 03:20:34.184004 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46610) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:34.304392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a147c7-54b3-43e8-8318-910f520de26d req-a60f2b91-4283-4bf2-9dc5-4aee70e755d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.304392 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-42a147c7-54b3-43e8-8318-910f520de26d req-a60f2b91-4283-4bf2-9dc5-4aee70e755d3 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=f0e656658949487fb898565d34636908&shared=False HTTP/1.1" status: 200 len: 913 time: 0.2729921 Nov 16 03:20:34.356027 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe1853a9-8a1d-4a8e-8513-67690c6dcb2f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:34.420053 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe1853a9-8a1d-4a8e-8513-67690c6dcb2f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:34.489638 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-4dcb82f1-5aaa-4a82-9b84-01653b807aa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.492627 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-4dcb82f1-5aaa-4a82-9b84-01653b807aa3 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 914 time: 0.5831709 Nov 16 03:20:34.501878 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 7f64383f-ace3-4b55-80d1-414d29eacb2f no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:20:34.510984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe1853a9-8a1d-4a8e-8513-67690c6dcb2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:34.515121 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fe1853a9-8a1d-4a8e-8513-67690c6dcb2f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:34.520379 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-fe1853a9-8a1d-4a8e-8513-67690c6dcb2f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/d59f1128-96e8-4a12-a73b-25548af67b95 HTTP/1.1" status: 204 len: 168 time: 0.3302059 Nov 16 03:20:34.550118 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 7f64383f-ace3-4b55-80d1-414d29eacb2f {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:20:34.551127 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 7f64383f-ace3-4b55-80d1-414d29eacb2f not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:20:34.575498 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe1853a9-8a1d-4a8e-8513-67690c6dcb2f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d59f1128-96e8-4a12-a73b-25548af67b95,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:34.578446 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a147c7-54b3-43e8-8318-910f520de26d req-6efdeb40-c312-4ebe-b515-571875ccda38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.582833 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-42a147c7-54b3-43e8-8318-910f520de26d req-6efdeb40-c312-4ebe-b515-571875ccda38 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2723241 Nov 16 03:20:34.656918 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-23f0a55f-2ea5-48fe-ab4c-d8809fc8196b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b HTTP/1.1" status: 200 len: 217 time: 0.1350410 Nov 16 03:20:34.735205 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-4338022a-b4f7-4ad6-88bb-09307d861cd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.737682 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-4338022a-b4f7-4ad6-88bb-09307d861cd3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=eb17dc2c-fa73-481e-b845-85a7c8e8df27 HTTP/1.1" status: 200 len: 853 time: 0.0695350 Nov 16 03:20:34.749948 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b32bae-5180-40d0-9d3f-b3097515cf3d req-a66b5ba0-4ca0-43c6-a79d-4630a9e7e5f0 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.761111 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-21b32bae-5180-40d0-9d3f-b3097515cf3d req-a66b5ba0-4ca0-43c6-a79d-4630a9e7e5f0 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 943 time: 0.2765877 Nov 16 03:20:34.767901 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-2793fd5e-9375-4041-9db9-373a3d121aa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.772470 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-2793fd5e-9375-4041-9db9-373a3d121aa4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1096 time: 0.1177804 Nov 16 03:20:34.833339 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ce5ab7-c441-43d5-a453-831ee40ecb2a req-d928a31b-1124-40e5-bdcc-099db828c91a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.842707 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44ce5ab7-c441-43d5-a453-831ee40ecb2a req-d928a31b-1124-40e5-bdcc-099db828c91a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.3607843 Nov 16 03:20:34.879182 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-c5f0235c-e94a-40ce-ab47-7a0991bac7cf service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1 HTTP/1.1" status: 200 len: 217 time: 0.0912349 Nov 16 03:20:34.891798 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-5b8d84c8-040a-4d79-b050-2aee67763289 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b79535bc-1164-4d3a-bbe9-6176a19d036c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1265652 Nov 16 03:20:34.907407 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-21b32bae-5180-40d0-9d3f-b3097515cf3d req-76092153-d7c1-4ad2-bb8a-42600c4e51f7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1447780 Nov 16 03:20:34.984460 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-5fc5b250-3b41-4540-8723-587e10ed4dd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:34.987170 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-5fc5b250-3b41-4540-8723-587e10ed4dd5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0983083 Nov 16 03:20:35.086529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-c7a6f7c3-dd67-444a-b427-b38da4149e82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:35.088694 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-7b7aebe6-642a-4722-ab49-7b18f6418f43 service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1623087 Nov 16 03:20:35.089069 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-c7a6f7c3-dd67-444a-b427-b38da4149e82 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0868669 Nov 16 03:20:35.227244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44ce5ab7-c441-43d5-a453-831ee40ecb2a req-b2255622-4d5f-4eb0-a285-118f17b78c04 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3830330 Nov 16 03:20:35.291284 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-44d8fc84-988d-4c52-af96-efc5d2a8f58c req-ec05bf94-b6d1-4945-9fc6-de058295c747 service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1880507 Nov 16 03:20:35.297521 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-f058520d-4fed-42dd-91fd-12da6a058578 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1949470 Nov 16 03:20:35.429679 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-31908f92-7179-4a3d-b2f2-51f23850b294 req-8ae4dddc-ccd6-4b18-99aa-338e76f8bc73 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1139596 Nov 16 03:20:35.727986 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 28525ffc-1c38-4068-bbad-deeb2fb7501b details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:20:35.883841 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:35.954378 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 28525ffc-1c38-4068-bbad-deeb2fb7501b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:35.981084 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '28525ffc-1c38-4068-bbad-deeb2fb7501b', 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c', 'port_id': '28525ffc-1c38-4068-bbad-deeb2fb7501b', 'mac_address': 'fa:16:3e:96:e0:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 321, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb17dc2c-fa73-481e-b845-85a7c8e8df27', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:20:36.032512 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.054633 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 28525ffc-1c38-4068-bbad-deeb2fb7501b {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:20:36.065556 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46648) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:36.094471 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 28525ffc-1c38-4068-bbad-deeb2fb7501b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:36.101026 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.167221 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=28525ffc-1c38-4068-bbad-deeb2fb7501b,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:36.175810 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.176152 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.176486 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.177872 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.177872 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.177872 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.178322 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.178491 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.179048 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.179383 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.179713 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.180038 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:36.213487 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0bc7b58-09ad-4a62-9560-7c113b7f28ca req-a320b67f-2da8-4e1e-8109-4696f7a4d680 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:36.216595 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e0bc7b58-09ad-4a62-9560-7c113b7f28ca req-a320b67f-2da8-4e1e-8109-4696f7a4d680 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 943 time: 0.1616008 Nov 16 03:20:36.283911 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e0bc7b58-09ad-4a62-9560-7c113b7f28ca req-2de85d12-2c5b-4105-be5b-acad86cacfe7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594480 Nov 16 03:20:36.387407 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-684471443-network', 'tenant_id': '2852179c69834bda8a41052f2d958cd4'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:36.406402 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['28525ffc-1c38-4068-bbad-deeb2fb7501b'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:36.455085 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Made reservation on behalf of 2852179c69834bda8a41052f2d958cd4 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:36.459339 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.472882 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.500046 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c8f1f1-8df1-4d4a-93bc-108d4210f513 req-efccc71a-c3d2-481c-b852-7d1b98d0883c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:36.502808 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c8f1f1-8df1-4d4a-93bc-108d4210f513 req-efccc71a-c3d2-481c-b852-7d1b98d0883c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.0964143 Nov 16 03:20:36.638007 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c8f1f1-8df1-4d4a-93bc-108d4210f513 req-988f74d6-a880-443e-a7a6-5ab80506a1fa tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1202152 Nov 16 03:20:36.717031 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.729702 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.762491 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 347} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:20:36.788864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4835c79f-ca18-4dad-b1d1-dd358884040e,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:36.792767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.793761 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Added segment 5625e5e7-479e-49a0-b312-cb57638f9297 of type vlan for network 9af16874-689f-4be5-82a5-a21abe98a824 Nov 16 03:20:36.857471 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.895756 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.895756 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:36.896102 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.917972 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.8491015 Nov 16 03:20:36.921659 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46666) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:36.928689 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Request body: {'subnet': {'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-subnet', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:36.966664 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Made reservation on behalf of 2852179c69834bda8a41052f2d958cd4 for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:36.970391 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:36.982847 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6f9f75-3cea-4f52-b884-1db022050eae admin admin] Pushing event updated for resources: {'Network': ['ID=9af16874-689f-4be5-82a5-a21abe98a824,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:36.996940 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 9af16874-689f-4be5-82a5-a21abe98a824 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:20:37.243099 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.316202 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Pushing event updated for resources: {'Subnet': ['ID=9e247800-f503-4caf-a4ea-6ee4bbc46e25,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:37.324846 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Checking segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:37.325216 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Network hostable DHCP agents. Network: 9af16874-689f-4be5-82a5-a21abe98a824, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:20:37.359035 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Network 9af16874-689f-4be5-82a5-a21abe98a824 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:20:37.372456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 9af16874-689f-4be5-82a5-a21abe98a824) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:37.381016 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:37.382005 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.387804 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0816353e-4001-4dad-9e69-ebc15598e728 None None] Network 9af16874-689f-4be5-82a5-a21abe98a824 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:37.481010 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-197c6026-4d1d-46bb-8152-3b27e016f49c admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5543473 Nov 16 03:20:37.481745 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46670) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:37.492802 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:37.538714 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c60ea07-3da1-4432-b210-8a5b39e256f8 req-0363760e-53da-44af-bbd7-2e1da00a8b10 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:37.541312 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c60ea07-3da1-4432-b210-8a5b39e256f8 req-0363760e-53da-44af-bbd7-2e1da00a8b10 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 944 time: 0.1487498 Nov 16 03:20:37.555166 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.563051 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.629007 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.640643 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c60ea07-3da1-4432-b210-8a5b39e256f8 req-747c9a12-71a3-4c0e-9223-805e9f61f03e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873456 Nov 16 03:20:37.708407 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-9af16874-689f-4be5-82a5-a21abe98a824', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:20:37.710322 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.744336 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 28525ffc-1c38-4068-bbad-deeb2fb7501b up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:37.882306 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:37.967259 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 28525ffc-1c38-4068-bbad-deeb2fb7501b completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:20:37.968831 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b3a93d-c030-48ef-beaf-19d914f7c56d req-2309f905-d11e-41c1-a5cd-e682c2d2b599 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:37.971391 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-97b3a93d-c030-48ef-beaf-19d914f7c56d req-2309f905-d11e-41c1-a5cd-e682c2d2b599 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.1991322 Nov 16 03:20:38.027718 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 28525ffc-1c38-4068-bbad-deeb2fb7501b triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:38.029811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.170198 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-97b3a93d-c030-48ef-beaf-19d914f7c56d req-4667174e-f83c-4114-84a4-9e1881e4fddd tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1834967 Nov 16 03:20:38.206032 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Allocated IP 172.20.0.2 (9af16874-689f-4be5-82a5-a21abe98a824/9e247800-f503-4caf-a4ea-6ee4bbc46e25/fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:38.304939 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.343740 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 28525ffc-1c38-4068-bbad-deeb2fb7501b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:38.346976 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28525ffc-1c38-4068-bbad-deeb2fb7501b'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:38.349978 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ee1b354-afb0-4745-95f0-ee0d3df999c8" -d '{"events": [{"server_uuid": "5ed5ed50-c2a1-47a7-a744-23b6c614cfa4", "name": "network-vif-plugged", "status": "completed", "tag": "28525ffc-1c38-4068-bbad-deeb2fb7501b"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:38.358133 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.451630 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be6e75ed-9062-41af-be35-e6d7079295f6 x-openstack-request-id: req-be6e75ed-9062-41af-be35-e6d7079295f6 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:38.452132 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ed5ed50-c2a1-47a7-a744-23b6c614cfa4", "name": "network-vif-plugged", "status": "completed", "tag": "28525ffc-1c38-4068-bbad-deeb2fb7501b", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:38.452464 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-be6e75ed-9062-41af-be35-e6d7079295f6 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:38.452965 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28525ffc-1c38-4068-bbad-deeb2fb7501b', 'code': 200} Nov 16 03:20:38.504458 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.515044 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=28525ffc-1c38-4068-bbad-deeb2fb7501b,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:38.531054 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.580315 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46696) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:38.593167 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.602426 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.745211 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9f574d-3fba-42f6-975c-4962c4236933 req-f7461d8d-463e-4d8d-951d-b4eece3bb8d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:38.746890 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ed9f574d-3fba-42f6-975c-4962c4236933 req-f7461d8d-463e-4d8d-951d-b4eece3bb8d6 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 1098 time: 0.0850687 Nov 16 03:20:38.754157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Allocated IP 172.27.1.58 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/65d2ee09-0dda-4c92-9983-1bcd281d4ad9) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:38.754460 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3a95b4ec-7f4b-4794-b01e-05d117455a68 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.769808 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Network 9af16874-689f-4be5-82a5-a21abe98a824 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:38.774764 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:38.781229 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:38.809819 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Pushing event updated for resources: {'Port': ['ID=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:38.867643 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Attempting to bind port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:38.868404 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Attempting to bind port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:38.869007 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Attempting to bind port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 on network 9af16874-689f-4be5-82a5-a21abe98a824 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:38.878236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:38.879014 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Checking segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:38.879615 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.880208 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Bound using segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:38.881082 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Bound port: fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:38.882101 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.885423 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ed9f574d-3fba-42f6-975c-4962c4236933 req-0ea60977-6b4f-4fce-9c1c-9f7d21f893a2 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1288800 Nov 16 03:20:38.912048 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3a95b4ec-7f4b-4794-b01e-05d117455a68 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.934574 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3a95b4ec-7f4b-4794-b01e-05d117455a68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:38.981850 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.002107 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] For port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:39.009331 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] For port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:39.018789 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.023542 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ce4511-8d0c-4bef-a206-eb045b9d8f15 req-4a1e1b5c-986d-410c-a4e1-1f0beeb2de59 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:39.024596 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.029415 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-62ce4511-8d0c-4bef-a206-eb045b9d8f15 req-4a1e1b5c-986d-410c-a4e1-1f0beeb2de59 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.2401812 Nov 16 03:20:39.033498 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-3a95b4ec-7f4b-4794-b01e-05d117455a68 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=71fd9633ecda4a2b98d9fd43520cfd3a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4508815 Nov 16 03:20:39.036804 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46702) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:39.090932 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b6668c-9758-451b-89a7-75fd09055d97 None None] Pushing event updated for resources: {'Port': ['ID=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:39.119631 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Pushing event updated for resources: {'Port': ['ID=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:39.132752 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:39.134534 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:39.137206 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:39.144781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a95b4ec-7f4b-4794-b01e-05d117455a68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f200b6c3-3f2f-4eee-a12f-d0487f1ae8da,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:39.210080 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-62ce4511-8d0c-4bef-a206-eb045b9d8f15 req-350c2d3d-b58f-4481-a62e-eef5febaf9cf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923519 Nov 16 03:20:39.213622 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a50a284c-fc7a-410e-804e-80632ff797c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.281081 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a50a284c-fc7a-410e-804e-80632ff797c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.522271 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd27fc57-996e-48b2-b8be-4c0f6cf0c00a req-6ef92d16-b882-42c6-949e-01eb60783e65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:39.524132 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd27fc57-996e-48b2-b8be-4c0f6cf0c00a req-6ef92d16-b882-42c6-949e-01eb60783e65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.2051444 Nov 16 03:20:39.524817 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a50a284c-fc7a-410e-804e-80632ff797c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.527523 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a50a284c-fc7a-410e-804e-80632ff797c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:39.528998 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a50a284c-fc7a-410e-804e-80632ff797c7 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f200b6c3-3f2f-4eee-a12f-d0487f1ae8da HTTP/1.1" status: 204 len: 168 time: 0.4903312 Nov 16 03:20:39.565199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a50a284c-fc7a-410e-804e-80632ff797c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f200b6c3-3f2f-4eee-a12f-d0487f1ae8da,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:39.655039 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fd27fc57-996e-48b2-b8be-4c0f6cf0c00a req-9bc0219a-efc5-46fd-8773-4a28867e50ca tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1127288 Nov 16 03:20:39.996070 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:40.290623 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:40.397099 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18cc5f0-39a9-4288-9bcf-fc8ac05a1132 req-d783f671-5ab8-419f-9221-9afe3a2b0048 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:40.410585 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e18cc5f0-39a9-4288-9bcf-fc8ac05a1132 req-d783f671-5ab8-419f-9221-9afe3a2b0048 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.1049809 Nov 16 03:20:40.502724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101898) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:20:40.516022 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e18cc5f0-39a9-4288-9bcf-fc8ac05a1132 req-1f88fc5d-153a-4774-8958-7ab2e41a0d7a tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984905 Nov 16 03:20:40.643999 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:40.754423 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c32bf53f-ba61-48c0-9254-5761fabd0e13 None None] Network 9af16874-689f-4be5-82a5-a21abe98a824 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:20:40.766313 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:40.818673 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:40.827074 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-95320ad4-9617-461e-8906-986f8e38aeb1 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.3398709 Nov 16 03:20:40.827655 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46762) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:40.889786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddaf7de8-f608-4461-8599-f146bb507a2d req-cc3ee4b9-09e9-4500-be46-7f1ecf43ee93 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:40.890687 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:40.893588 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ddaf7de8-f608-4461-8599-f146bb507a2d req-cc3ee4b9-09e9-4500-be46-7f1ecf43ee93 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.1471217 Nov 16 03:20:41.018136 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:41.020565 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:41.058360 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ddaf7de8-f608-4461-8599-f146bb507a2d req-9f3ec2e4-b8a9-43a5-a96f-17774aef1cee tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1522164 Nov 16 03:20:41.168967 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-266b8aa9-f4af-44ae-bc80-279b44302261 None None] Provisioning complete for port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:41.169415 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-266b8aa9-f4af-44ae-bc80-279b44302261 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:41.213952 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:41.214611 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:41.460398 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:41.763781 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:20:41.794753 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-266b8aa9-f4af-44ae-bc80-279b44302261 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:41.813877 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:41.936000 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.104061 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-266b8aa9-f4af-44ae-bc80-279b44302261 None None] For port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:42.123227 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-266b8aa9-f4af-44ae-bc80-279b44302261 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.309915 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6922ad1f-b17f-4f54-b8b2-82def81f5f6f req-59f58c56-42f5-4ed1-8594-c881cbe69d34 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:42.313759 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6922ad1f-b17f-4f54-b8b2-82def81f5f6f req-59f58c56-42f5-4ed1-8594-c881cbe69d34 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.1287656 Nov 16 03:20:42.323177 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:42.342155 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'port_id': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'mac_address': 'fa:16:3e:3c:36:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:20:42.390393 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.db.api [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=101900) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 16 03:20:42.390748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG oslo_db.api [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 16 03:20:42.394445 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-7bdf67da-b773-4f51-b357-f339a91606ef None None] Provisioning complete for port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:42.394445 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7bdf67da-b773-4f51-b357-f339a91606ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.396706 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266b8aa9-f4af-44ae-bc80-279b44302261 None None] Pushing event updated for resources: {'Port': ['ID=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:42.410998 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6922ad1f-b17f-4f54-b8b2-82def81f5f6f req-5d075cb1-1c0b-407d-8d2c-18ec7a1f5625 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0835075 Nov 16 03:20:42.468380 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Allocated IP 172.20.0.1 (9af16874-689f-4be5-82a5-a21abe98a824/9e247800-f503-4caf-a4ea-6ee4bbc46e25/04d186a9-0a0b-497c-8c8f-737a90f61291) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:42.510034 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:39Z', 'revision_number': 3, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:42.580948 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:42.581811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Updating router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:20:42.623630 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.723826 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.761412 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.796561 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:20:42.821376 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:42.904965 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Network 9af16874-689f-4be5-82a5-a21abe98a824 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:42.908904 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:42.911817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:42.979085 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:43.024522 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Pushing event updated for resources: {'Port': ['ID=04d186a9-0a0b-497c-8c8f-737a90f61291,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:43.076060 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:43.090785 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:43.304529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:43.712213 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:43.845998 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['708ca4dc-7d1f-4191-b1d2-fe81df173fc1'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:20:43.851384 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb4285fe-b62a-4f50-93da-13a1f62807a2 req-afea9d40-04e4-4e4c-b379-25357086d6bf tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:43.855416 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb4285fe-b62a-4f50-93da-13a1f62807a2 req-afea9d40-04e4-4e4c-b379-25357086d6bf tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 944 time: 0.1827574 Nov 16 03:20:43.936173 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:43.944922 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:43.951269 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-a8913d83-38a3-4611-83b0-5f9bc9ad8706 None None] Provisioning complete for port 04d186a9-0a0b-497c-8c8f-737a90f61291 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:43.951707 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a8913d83-38a3-4611-83b0-5f9bc9ad8706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:43.959646 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb4285fe-b62a-4f50-93da-13a1f62807a2 req-18e8bfaf-255e-44b3-a9ab-256c9998b55d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0939186 Nov 16 03:20:44.006979 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:44.023377 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.094028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Pushing event updated for resources: {'Port': ['ID=04d186a9-0a0b-497c-8c8f-737a90f61291,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:44.094028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.095152 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.101002 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-a8913d83-38a3-4611-83b0-5f9bc9ad8706 None None] Port 04d186a9-0a0b-497c-8c8f-737a90f61291 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:44.163891 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:44.164360 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.211061 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506033a7-7326-46a9-aa24-f95641f15a73 None None] Pushing event updated for resources: {'Port': ['ID=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:44.212499 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Network 9af16874-689f-4be5-82a5-a21abe98a824 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:44.223810 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:44.226349 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Attempting to bind port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:44.226349 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Attempting to bind port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:44.226737 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Attempting to bind port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:44.246734 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:44.247209 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:44.247542 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.247937 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:44.248437 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Bound port: 65d2ee09-0dda-4c92-9983-1bcd281d4ad9, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:44.248823 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.475236 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:20:44.485199 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] For port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:44.557734 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] For port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:44.573673 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5820d0d6-91c0-4f9b-97ae-bae63cf20ca5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.592416 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.689772 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:44.710351 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-4d891d35-8d2d-4784-b2fd-8c9e0165bc60 admin admin] 10.222.0.31 "PUT /v2.0/routers/f0f29b2e-1450-4ba9-970f-d8f3d4193b97/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8770542 Nov 16 03:20:44.816388 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:44.817344 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:44.943557 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-ab1b682f-a3e7-4122-b62c-d0842dba92a2 None None] Provisioning complete for port 04d186a9-0a0b-497c-8c8f-737a90f61291 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:44.944987 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ab1b682f-a3e7-4122-b62c-d0842dba92a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:44.981635 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506033a7-7326-46a9-aa24-f95641f15a73 None None] Pushing event updated for resources: {'Port': ['ID=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:45.069491 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-ab1b682f-a3e7-4122-b62c-d0842dba92a2 None None] Port 04d186a9-0a0b-497c-8c8f-737a90f61291 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:45.132192 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:20:45.168213 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6f1b6e-9ed3-4e96-869f-f5908cb53eef req-4ea8b7b2-5100-4e68-be8c-8be353f337b4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:45.177462 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6f1b6e-9ed3-4e96-869f-f5908cb53eef req-4ea8b7b2-5100-4e68-be8c-8be353f337b4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 944 time: 0.0907536 Nov 16 03:20:45.189748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:45.246144 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da6f1b6e-9ed3-4e96-869f-f5908cb53eef req-af2b2814-f556-40eb-bbe9-86282f781d4e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0667548 Nov 16 03:20:45.589162 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 2, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:45.637934 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e31f518d-f720-49bb-b8f6-75ac910da193 None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 2, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:45.960736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 46860) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:45.968120 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2031629795', 'description': 'tempest-description--1921342059'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:46.016769 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.151838 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.157514 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.203212 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.204533 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.2425065 Nov 16 03:20:46.208036 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46864) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:46.210528 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb41eab7-b535-4e9b-bcc7-d4e2805387a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:46.214745 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'security_group_rule': {'security_group_id': 'd8544b57-fd77-41bc-85ab-4c4d7d8fcc0f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:46.269590 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.391083 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.399112 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.438587 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b6840293-3059-4801-adff-0d66836574e6,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:46.450894 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.459338 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-93cea8b4-3858-4637-b8b0-00a91741caee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2481503 Nov 16 03:20:46.459338 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46884) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:46.465640 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'security_group_rule': {'security_group_id': 'd8544b57-fd77-41bc-85ab-4c4d7d8fcc0f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:46.502984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860b369a-ca24-4307-bb99-53dada9f35d5 req-47fbef28-ee77-44d9-951d-717b59f2e30d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:46.512372 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-860b369a-ca24-4307-bb99-53dada9f35d5 req-47fbef28-ee77-44d9-951d-717b59f2e30d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 944 time: 0.1717784 Nov 16 03:20:46.525789 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.624960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-183ac33f-be5d-47fa-ac52-378ad7fdea43 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:46.627149 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-183ac33f-be5d-47fa-ac52-378ad7fdea43 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 814 time: 0.2422483 Nov 16 03:20:46.642258 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-860b369a-ca24-4307-bb99-53dada9f35d5 req-f90280e8-da2b-4a87-9979-d4a1272298e3 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1287844 Nov 16 03:20:46.673741 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.691941 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.698281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-8ad4a9af-2446-49d4-bc96-d483329faa06 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/quotas/76754ec1f4b143ceabbcb17af1aa513b HTTP/1.1" status: 200 len: 375 time: 0.0476186 Nov 16 03:20:46.717816 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7f73ea71-14a1-4d8e-9922-193fba42c71d,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:46.727276 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.729687 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-78514b21-d9cd-423d-98e3-63592d5e20c1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2693188 Nov 16 03:20:46.733066 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 46886) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:46.757338 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:46.795296 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.841568 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-62e7150e-58a9-4620-bff3-c2bb1a1d60ec tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1362920 Nov 16 03:20:46.955779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:46.984992 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-9051ea5e-e0f1-4899-ad31-6348e63ae754 service neutron] 10.222.0.31 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277251 Nov 16 03:20:47.136745 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Allocated IP 172.27.1.105 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/3f163731-0067-4fb6-a6bf-1ee31d60eede) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:47.137321 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-c61f44d2-88a4-42e4-ac56-55d7d7c8c031 service neutron] 10.222.0.31 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358783 Nov 16 03:20:47.288603 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:47.345937 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:47.414713 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:47.416547 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:47.451893 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:47.525163 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:47.529920 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:47.535202 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:47.567970 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-503969e4-69b3-4003-9b73-5343c66636c3 req-5f30a61d-21fa-4b24-8204-d17f4d891841 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 210 time: 0.0710416 Nov 16 03:20:47.604664 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'Port': ['ID=3f163731-0067-4fb6-a6bf-1ee31d60eede,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:47.622471 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:47.653951 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:47.660336 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:47.797388 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:47.849218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:47.851906 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e082679-0fc6-4913-bb41-73a398f24d52 req-ea3ec89c-0e99-40f7-9be2-e91ec7e1eafe tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:47.862622 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e082679-0fc6-4913-bb41-73a398f24d52 req-ea3ec89c-0e99-40f7-9be2-e91ec7e1eafe tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 944 time: 0.1043422 Nov 16 03:20:47.942808 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e082679-0fc6-4913-bb41-73a398f24d52 req-261c2d11-91bf-49fa-a4b4-6d0dc59aacbb tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0786042 Nov 16 03:20:47.946595 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:48.224158 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:48.231378 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:48.307825 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'Port': ['ID=3f163731-0067-4fb6-a6bf-1ee31d60eede,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:48.320143 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:48.338334 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:48.339688 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-9a3cfe7c-2dea-4ee5-b9dd-c8d0bdd94cd3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.5929253 Nov 16 03:20:48.457669 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e0019fe3-f622-41ea-8211-618c43c2b4b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:48.528130 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-2e07c319-7ef5-41c0-830e-7161aa1feedb tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--2031629795&fields=id&tenant_id=2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 267 time: 0.0608721 Nov 16 03:20:48.664314 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-58cf5179-4336-4b31-bd53-c2184cc01737 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:48.666953 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-58cf5179-4336-4b31-bd53-c2184cc01737 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 816 time: 0.1287889 Nov 16 03:20:48.699271 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:48.710898 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92e2ea23-2588-4775-8724-f42b7fd8082f req-1711804c-9576-4bb0-8d26-f62b46839ec3 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 210 time: 0.0373328 Nov 16 03:20:48.711232 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:48.711944 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:48.713684 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-774fd48a-3f09-42ba-b991-d6fa3ced69ae tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/quotas/2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 375 time: 0.0314152 Nov 16 03:20:48.784995 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-fa1c7563-b667-401d-a005-bb7aa202680f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0591664 Nov 16 03:20:48.853930 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:48.896275 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-7e9832cf-4fb0-4940-850b-bc75de860d13 service neutron] 10.222.0.31 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909336 Nov 16 03:20:49.000127 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:49.079275 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:20:49.090736 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:49.091396 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.153262 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 2, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:49.203576 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.221234 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:49.221951 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Updating router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 port 04d186a9-0a0b-497c-8c8f-737a90f61291 binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:20:49.237025 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:49.247748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:49.250657 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7650f40-42ae-47db-b577-5815645b0c76" -d '{"events": [{"server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "name": "network-vif-plugged", "status": "completed", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:49.254873 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.288410 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:49.299071 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.361941 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:49.363325 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.398108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:49.416076 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-67c17e28-b08e-49cf-978d-4a26ce8b05c6 service neutron] 10.222.0.31 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5094006 Nov 16 03:20:49.431828 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffca2be5-f5a3-4617-b234-7016f2732b9b req-0e02cb62-c281-4b0d-9717-69af5bc83deb tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:49.445477 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ffca2be5-f5a3-4617-b234-7016f2732b9b req-0e02cb62-c281-4b0d-9717-69af5bc83deb tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.1534183 Nov 16 03:20:49.524299 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ffca2be5-f5a3-4617-b234-7016f2732b9b req-52bbdbfd-09c3-4334-87d6-02900ff49a5f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754437 Nov 16 03:20:49.575395 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd6d86d0-a927-452a-a0b1-d21bd1a8a020 x-openstack-request-id: req-cd6d86d0-a927-452a-a0b1-d21bd1a8a020 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:49.575900 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "name": "network-vif-plugged", "status": "completed", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:49.576269 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-cd6d86d0-a927-452a-a0b1-d21bd1a8a020 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:49.576603 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'code': 200} Nov 16 03:20:49.632906 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-877134af-e048-4a4b-988d-ba6b53375616 req-bddcc1f2-1b9b-492b-9a5f-066af3e9afa0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0282543 Nov 16 03:20:49.668441 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.677477 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.742820 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Pushing event updated for resources: {'Port': ['ID=04d186a9-0a0b-497c-8c8f-737a90f61291,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:49.754891 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.755556 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.756231 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.756782 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.757322 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.757744 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.758145 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.758532 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.758931 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.759350 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.759720 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.760104 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:20:49.762960 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.848153 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Attempting to bind port 04d186a9-0a0b-497c-8c8f-737a90f61291 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:20:49.848797 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Attempting to bind port 04d186a9-0a0b-497c-8c8f-737a90f61291 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:20:49.849374 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Attempting to bind port 04d186a9-0a0b-497c-8c8f-737a90f61291 on network 9af16874-689f-4be5-82a5-a21abe98a824 {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:20:49.856331 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:20:49.857092 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Checking segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:20:49.857766 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.858403 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Bound using segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:20:49.859043 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Bound port: 04d186a9-0a0b-497c-8c8f-737a90f61291, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:20:49.859725 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:49.873678 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-16da0419-b0b8-4c70-9f60-1b0e56c2edf9 req-f5da636d-dc53-4039-92bb-605a1fe905fe tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 210 time: 0.0393159 Nov 16 03:20:49.950476 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] For port 04d186a9-0a0b-497c-8c8f-737a90f61291, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:20:49.955931 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] For port 04d186a9-0a0b-497c-8c8f-737a90f61291, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=04d186a9-0a0b-497c-8c8f-737a90f61291,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:20:49.961197 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:50.022084 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e55821-5cc1-4940-b1f2-aca06577882d None None] Pushing event updated for resources: {'Port': ['ID=04d186a9-0a0b-497c-8c8f-737a90f61291,revision_number=4']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:50.047468 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:50.048148 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:50.074389 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-472abcef-2a54-4625-9109-860ba2230019 None None] Provisioning complete for port 04d186a9-0a0b-497c-8c8f-737a90f61291 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:50.079150 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-472abcef-2a54-4625-9109-860ba2230019 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:50.263399 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:50.320727 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-472abcef-2a54-4625-9109-860ba2230019 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:50.380199 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-472abcef-2a54-4625-9109-860ba2230019 None None] For port 04d186a9-0a0b-497c-8c8f-737a90f61291, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=04d186a9-0a0b-497c-8c8f-737a90f61291,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:20:50.389239 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-472abcef-2a54-4625-9109-860ba2230019 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:50.467455 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472abcef-2a54-4625-9109-860ba2230019 None None] Pushing event updated for resources: {'Port': ['ID=04d186a9-0a0b-497c-8c8f-737a90f61291,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:50.480503 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b36933d7-4ec7-4615-8541-fbead1953a1e req-14baa34d-79d3-4e25-9756-0a5a40dbcc5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:50.482810 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b36933d7-4ec7-4615-8541-fbead1953a1e req-14baa34d-79d3-4e25-9756-0a5a40dbcc5e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1098 time: 0.0915058 Nov 16 03:20:50.538109 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-d76be98f-e1b1-4b3d-a1f1-4d91607c7c91 None None] Provisioning complete for port 04d186a9-0a0b-497c-8c8f-737a90f61291 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:50.538748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d76be98f-e1b1-4b3d-a1f1-4d91607c7c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:50.592945 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b36933d7-4ec7-4615-8541-fbead1953a1e req-7127f9ef-1b6d-40d8-8479-78459245a526 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0925567 Nov 16 03:20:50.675911 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfc8145-bf6f-4211-b1ab-1854903a45ea req-1365fc4a-148d-45d6-82a3-1d830b4dd4ee tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:50.677721 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-464019c5-1728-4066-8500-58afdeaa023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:49Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:50.684974 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5bfc8145-bf6f-4211-b1ab-1854903a45ea req-1365fc4a-148d-45d6-82a3-1d830b4dd4ee tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.0797679 Nov 16 03:20:50.763301 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5bfc8145-bf6f-4211-b1ab-1854903a45ea req-6846da85-414c-4129-9bcb-4e365273169c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0773709 Nov 16 03:20:50.779907 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92e3bc5d-b4d8-411a-a48c-a7164d5dd7ba req-035cdfda-9f2a-41e0-879f-18f8cbbd0355 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0454521 Nov 16 03:20:50.820166 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-464019c5-1728-4066-8500-58afdeaa023f None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:49Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:51.000611 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a77df86-c936-4740-b675-1fe644a1eea2 req-d4ce904d-cb5b-4544-a6f4-2876db4fe35a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 210 time: 0.0291660 Nov 16 03:20:51.295331 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 04d186a9-0a0b-497c-8c8f-737a90f61291 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:20:51.389165 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 04d186a9-0a0b-497c-8c8f-737a90f61291 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:51.389559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:51.478639 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-cee1ab58-98c1-4bc9-a5c6-3ec8f26bd582 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:51.481353 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-cee1ab58-98c1-4bc9-a5c6-3ec8f26bd582 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 814 time: 0.2633753 Nov 16 03:20:51.508425 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'port': {'device_id': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'admin_state_up': True, 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:51.546072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:51.615431 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:51.707783 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Made reservation on behalf of 76754ec1f4b143ceabbcb17af1aa513b for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:20:51.712129 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:51.901617 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Allocated IP 172.20.0.10 (3d7e4ea5-05db-41ca-8436-96b38d0ef4ef/e24021b9-c30d-4d4e-b10a-332e32fda211/373f70dc-3a64-458a-a38c-adab3f4f3275) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:51.989142 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-212424ea-71e5-406f-8456-12d1a13b9cf1 req-ac840b72-8ed2-4a6e-bef8-911dd834ec69 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0421910 Nov 16 03:20:52.027681 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c13ff6e-eb22-4d72-9a33-0c1c53228d8d req-5814a8cc-c31e-4c92-be88-b2f8e4cb8dcc tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:52.062621 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c13ff6e-eb22-4d72-9a33-0c1c53228d8d req-5814a8cc-c31e-4c92-be88-b2f8e4cb8dcc tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.1620975 Nov 16 03:20:52.191635 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c13ff6e-eb22-4d72-9a33-0c1c53228d8d req-881877f9-fa77-4615-81e0-4e07b7e5e751 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1272964 Nov 16 03:20:52.324347 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8098163a-aadb-422c-a632-3181b2998032 req-9ef50f87-be02-4cb0-844d-20eefeab6d53 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 210 time: 0.1195948 Nov 16 03:20:52.518260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-2aa44386-e392-42dc-be8e-868ce2af67a0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:52.520323 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-2aa44386-e392-42dc-be8e-868ce2af67a0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 816 time: 0.2768488 Nov 16 03:20:52.700576 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-2c6c91fc-50bf-4603-8b79-16468d1e74a5 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 380 time: 0.1621802 Nov 16 03:20:52.791549 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:52.854298 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:52.889210 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:52.911761 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:52.917923 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:52.966902 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:52.989211 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:52.989909 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:53.012293 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-615fb061-6bdd-49b1-bc28-8655367a5dc6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5080981 Nov 16 03:20:53.199966 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5f817287-f3a6-44c1-898c-fdb6f02823da req-45962b7a-c735-4a0a-b46e-c63bddc6a875 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0453320 Nov 16 03:20:53.255808 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-0bf3a1b2-8058-486e-a2f4-ad43b1d17633 None None] Provisioning complete for port 373f70dc-3a64-458a-a38c-adab3f4f3275 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:20:53.256821 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0bf3a1b2-8058-486e-a2f4-ad43b1d17633 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:53.303254 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-0bf3a1b2-8058-486e-a2f4-ad43b1d17633 None None] Port 373f70dc-3a64-458a-a38c-adab3f4f3275 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:20:53.350340 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d2021d-2118-43e4-91c1-de76423a23e7 req-c42415bf-b796-4575-94a1-479c34931529 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:53.355192 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3d2021d-2118-43e4-91c1-de76423a23e7 req-c42415bf-b796-4575-94a1-479c34931529 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.0649681 Nov 16 03:20:53.437671 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3d2021d-2118-43e4-91c1-de76423a23e7 req-5f5bd7a3-634c-4cf3-87de-8e1fa46a588a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0686615 Nov 16 03:20:53.544041 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05eeda2-d2b1-446c-abae-1154d093439f req-aa2bec37-5094-402b-b8f2-39713f46a0c1 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:53.546073 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b05eeda2-d2b1-446c-abae-1154d093439f req-aa2bec37-5094-402b-b8f2-39713f46a0c1 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0977535 Nov 16 03:20:53.695580 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffff685-4449-4b90-8739-87ade35eb84c req-0a525460-ce3e-46e2-bd17-bc689cde89b5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:53.697219 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ffff685-4449-4b90-8739-87ade35eb84c req-0a525460-ce3e-46e2-bd17-bc689cde89b5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.1480794 Nov 16 03:20:53.702802 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b05eeda2-d2b1-446c-abae-1154d093439f req-92cff080-1d3d-4b7f-bd0c-44706e77021c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1195076 Nov 16 03:20:53.774062 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ffff685-4449-4b90-8739-87ade35eb84c req-6340cbad-a9a0-49a6-a5eb-d743ae40fae0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0698121 Nov 16 03:20:53.816716 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47032) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:54.071650 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cfa63ee-c65e-421e-bd6d-17458a6999fc tempest-TestVolumeBootPattern-1638411920 tempest-TestVolumeBootPattern-1638411920-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:54.073222 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3cfa63ee-c65e-421e-bd6d-17458a6999fc tempest-TestVolumeBootPattern-1638411920 tempest-TestVolumeBootPattern-1638411920-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1093 time: 0.2542574 Nov 16 03:20:54.079355 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47042) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:20:54.088140 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'port_id': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'tenant_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address': '172.20.0.4'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:20:54.120566 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:54.237149 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:54.375194 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-24dfa891-f7e6-4198-8445-51ed78be791b req-4f83008e-bf27-4424-b590-bca0f0f09e87 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0600419 Nov 16 03:20:54.382746 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Allocated IP 172.27.1.157 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/753523c1-46d0-4ff5-92f5-93ee7ec1f238) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:20:54.583284 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:54.623431 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:54.664077 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:20:54.673769 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:20:54.678935 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:20:54.735930 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=753523c1-46d0-4ff5-92f5-93ee7ec1f238,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:54.914442 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e751191-19f8-4e1b-89fe-d5af2905f5fa req-af6dafb5-358b-4ae1-b9d4-7eeb2aafb3c5 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:54.922832 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e751191-19f8-4e1b-89fe-d5af2905f5fa req-af6dafb5-358b-4ae1-b9d4-7eeb2aafb3c5 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0832958 Nov 16 03:20:54.996133 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e751191-19f8-4e1b-89fe-d5af2905f5fa req-0e32663c-345b-4e63-a99c-ccb0793325de tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718212 Nov 16 03:20:55.371153 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:55.540580 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:55.557998 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3850511-3b64-4057-a5bd-959aaad6f722 req-9d149220-f82e-472e-a01e-52b78ca9d8d6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0452201 Nov 16 03:20:55.792771 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:55.806331 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:55.883677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=753523c1-46d0-4ff5-92f5-93ee7ec1f238,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:20:55.903897 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:56.015384 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.l3_db [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Floating IP 603af913-04dd-45aa-b688-4ca042282370 associated. External IP: 172.27.1.157, port: 708ca4dc-7d1f-4191-b1d2-fe81df173fc1. Nov 16 03:20:56.216114 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bab42f0-3258-410a-ba71-668935c99749 req-773c74e0-3813-442b-ab62-50b3f8a10229 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:56.219382 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8bab42f0-3258-410a-ba71-668935c99749 req-773c74e0-3813-442b-ab62-50b3f8a10229 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0893364 Nov 16 03:20:56.325021 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8bab42f0-3258-410a-ba71-668935c99749 req-a19cf68b-f89e-4ad7-820a-59e029188bc3 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970335 Nov 16 03:20:56.428807 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:20:56.601619 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:20:56.631911 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:20:56.633575 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:20:56.648518 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:56.649489 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:56.672454 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-af87e6d2-438b-4202-9a3c-4982f08c007f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5918088 Nov 16 03:20:56.673201 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:20:56.675936 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5c3f634-8692-4093-98b8-96ac9439a31b" -d '{"events": [{"name": "network-changed", "server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:20:56.723310 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:20:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-015481da-7baf-45fa-b764-965c4b9e23fd x-openstack-request-id: req-015481da-7baf-45fa-b764-965c4b9e23fd {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:20:56.723611 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:20:56.724141 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-015481da-7baf-45fa-b764-965c4b9e23fd {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:20:56.724617 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'status': 'completed', 'code': 200} Nov 16 03:20:56.815013 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e8baab9-e723-4952-8cbb-9d9317dcaf52 req-d24a419c-6d69-41d1-9ee0-75d47bed6086 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0712006 Nov 16 03:20:56.896544 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:57.228154 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '603af913-04dd-45aa-b688-4ca042282370', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.157', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 520, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:3c:36:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:20:55Z', 'updated_at': '2021-11-16T03:20:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:57.257019 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:20:57.266946 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:20:57.267588 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:20:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:57.413943 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:20:57.497389 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1049ebed-5ab3-4962-8518-05df8e168644 req-aad235a2-0b3d-4043-a2b1-261333297b13 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:57.499424 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1049ebed-5ab3-4962-8518-05df8e168644 req-aad235a2-0b3d-4043-a2b1-261333297b13 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0672069 Nov 16 03:20:57.566247 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1049ebed-5ab3-4962-8518-05df8e168644 req-1498581e-5e9b-45f8-9d7f-43830dd1da0b tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593779 Nov 16 03:20:57.734777 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '603af913-04dd-45aa-b688-4ca042282370', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.157', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 520, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:3c:36:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:20:55Z', 'updated_at': '2021-11-16T03:20:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:20:57.764248 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eebc967e-7590-4faa-abf6-be47e36c8224 None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '603af913-04dd-45aa-b688-4ca042282370', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.157', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 520, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:3c:36:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:20:55Z', 'updated_at': '2021-11-16T03:20:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:20:57.942573 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-76d47188-2440-45fa-83c7-69aecde82fdf req-78ca1b33-75f4-4dfd-8ede-6955d1858b2b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0451238 Nov 16 03:20:58.093218 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb2d727-1894-4a07-8e15-e005fa7fdd5f None None] New status for floating IP 603af913-04dd-45aa-b688-4ca042282370: ACTIVE {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:20:58.724325 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e89dea4-32d3-4cb7-a211-57e30bbc57a0 req-d8ec4339-4c7f-42ee-b2f1-2fa290b3a0cd tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:58.726412 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7e89dea4-32d3-4cb7-a211-57e30bbc57a0 req-d8ec4339-4c7f-42ee-b2f1-2fa290b3a0cd tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0866311 Nov 16 03:20:58.819332 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7e89dea4-32d3-4cb7-a211-57e30bbc57a0 req-4dedf11f-f2c2-4c1e-b4a4-c657e3e8c3f5 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841396 Nov 16 03:20:59.069222 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1c1b9008-bffd-487c-a1bc-adbc48d281cc req-b795b04d-4d31-47df-8088-9a2a7dbfea99 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0325115 Nov 16 03:20:59.960701 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932c1443-dda4-4868-8212-48beac9ffc53 req-b1565d53-08d9-4966-b003-070b6cfcead0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:20:59.962350 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-932c1443-dda4-4868-8212-48beac9ffc53 req-b1565d53-08d9-4966-b003-070b6cfcead0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0636864 Nov 16 03:21:00.039793 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-932c1443-dda4-4868-8212-48beac9ffc53 req-25746e93-a3d9-4ccc-92fb-1b708f4260f2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645068 Nov 16 03:21:00.181644 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0d7ed640-b28e-4e2d-8fdb-7b26bba31b55 req-913e0bfd-2156-449f-8e4f-540a3d4c5115 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0342031 Nov 16 03:21:01.250673 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915d2b19-7c3d-496c-9fc7-3eb7946de13a req-8acb2590-aa84-4b8f-a96c-f92d47cb0937 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:01.258836 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-915d2b19-7c3d-496c-9fc7-3eb7946de13a req-8acb2590-aa84-4b8f-a96c-f92d47cb0937 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0976191 Nov 16 03:21:01.331543 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-915d2b19-7c3d-496c-9fc7-3eb7946de13a req-28e196fd-ce9d-40cd-97f4-8235b61c44cf tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701706 Nov 16 03:21:01.436503 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2b190dc4-584c-45ac-97cf-a7c9718c9d5d req-583f3925-5e63-42f9-8df5-336f33f7dfef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0328374 Nov 16 03:21:02.485619 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a958c2a8-2722-47f3-85b7-5f42a4828609 req-24fda440-29b5-4378-a746-625f2582af24 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:02.487600 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a958c2a8-2722-47f3-85b7-5f42a4828609 req-24fda440-29b5-4378-a746-625f2582af24 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0609343 Nov 16 03:21:02.553915 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a958c2a8-2722-47f3-85b7-5f42a4828609 req-22181a7d-c655-459f-b68b-b8c0b409dae8 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599613 Nov 16 03:21:02.648802 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8bc3d0f5-cae9-40bd-8785-b531b7adfe70 req-c956dd69-ce0e-4b2e-8aa0-1e129b9a1eae tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0268996 Nov 16 03:21:03.766404 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144673c4-2290-43fd-b4c7-753c2cdb1ab8 req-abfa3d15-743d-4e1c-b013-df6f845c2ba0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:03.768767 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-144673c4-2290-43fd-b4c7-753c2cdb1ab8 req-abfa3d15-743d-4e1c-b013-df6f845c2ba0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.0984135 Nov 16 03:21:03.883891 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-144673c4-2290-43fd-b4c7-753c2cdb1ab8 req-7d5017a1-7770-48ba-a661-d7edc7a69b32 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028533 Nov 16 03:21:04.001957 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-77d4abc8-da92-4bd4-b459-ca6518e7419c req-5e373bc2-e543-4794-88f4-89761c7da39a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0270252 Nov 16 03:21:04.770093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'port': {'device_id': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'admin_state_up': True, 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'security_groups': ['d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:04.771002 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Request body: {'port': {'device_id': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:04.834136 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:04.970567 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-33ad2258-046d-4627-b70e-5360181ca966 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:04.972772 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-33ad2258-046d-4627-b70e-5360181ca966 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1098 time: 0.1991706 Nov 16 03:21:05.135779 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Made reservation on behalf of 2852179c69834bda8a41052f2d958cd4 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:21:05.139025 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.190706 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ebec77a2-ea18-4dc9-81f4-f65978b20c6a req-ee18bbe5-4665-4119-9eaa-7170f0db54cc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0608699 Nov 16 03:21:05.199276 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-86df66c3-9908-487a-9fb0-22d527f1e625 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3605895 Nov 16 03:21:05.218113 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 373f70dc-3a64-458a-a38c-adab3f4f3275 {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:21:05.226343 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.239214 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Transition to ACTIVE for port object 373f70dc-3a64-458a-a38c-adab3f4f3275 will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:21:05.244189 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.279566 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef562dec-3fbf-4f90-afe7-d9dc936c9bce req-5e798333-2693-46ce-b359-ce423a686032 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.281086 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef562dec-3fbf-4f90-afe7-d9dc936c9bce req-5e798333-2693-46ce-b359-ce423a686032 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 932 time: 0.2717342 Nov 16 03:21:05.335892 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:05.358719 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.359133 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.359519 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.359891 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.360168 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.360530 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.360803 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.361818 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.361818 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.362198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.362529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.363079 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:05.377123 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-0974ae02-4042-4f21-9c6d-30381623457a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.378772 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-0974ae02-4042-4f21-9c6d-30381623457a service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.3789566 Nov 16 03:21:05.385813 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Attempting to bind port 373f70dc-3a64-458a-a38c-adab3f4f3275 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:21:05.385813 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Attempting to bind port 373f70dc-3a64-458a-a38c-adab3f4f3275 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:21:05.386297 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Attempting to bind port 373f70dc-3a64-458a-a38c-adab3f4f3275 on network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:21:05.388793 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef562dec-3fbf-4f90-afe7-d9dc936c9bce req-567b7f79-58a9-48b0-88bb-c9efe6cefdb0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809193 Nov 16 03:21:05.391255 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Port 373f70dc-3a64-458a-a38c-adab3f4f3275 on network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:21:05.391883 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Attempting to bind port 373f70dc-3a64-458a-a38c-adab3f4f3275 on network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:21:05.399000 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 20, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:21:05.399568 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Checking segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:21:05.400183 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Bound using segment: {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:21:05.400860 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Bound port: 373f70dc-3a64-458a-a38c-adab3f4f3275, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '25def757-4057-49a6-b5ef-3a5e0b9904b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 337, 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:21:05.401497 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.479440 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:21:05.483844 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:21:05.490904 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.519408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-bf678711-e37f-498d-8903-6bcedff23f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.520970 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-bf678711-e37f-498d-8903-6bcedff23f31 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 1098 time: 0.2272680 Nov 16 03:21:05.547923 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-ce63e206-7c74-4f06-b2d7-afaf1dea1f95 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1 HTTP/1.1" status: 200 len: 1001 time: 0.1581008 Nov 16 03:21:05.552707 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Allocated IP 172.20.0.14 (9af16874-689f-4be5-82a5-a21abe98a824/9e247800-f503-4caf-a4ea-6ee4bbc46e25/c8dba4d7-4e08-40c8-a119-0e68144a64b1) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:21:05.560896 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.561592 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.563436 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] 10.222.0.11 "PUT /v2.0/ports/373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 1094 time: 0.7976871 Nov 16 03:21:05.563962 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:05.566725 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-649337a9-b2ff-4b97-9402-ab2350c22e46" -d '{"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:05.599417 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2ac720-6b4c-4f4a-bda9-639921dfea07 service neutron] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:05.671075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d767e944-335b-45e0-9c85-a42ff4dd5a5c x-openstack-request-id: req-d767e944-335b-45e0-9c85-a42ff4dd5a5c {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:05.671342 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:05.671601 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-d767e944-335b-45e0-9c85-a42ff4dd5a5c {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:05.671992 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'status': 'completed', 'code': 200} Nov 16 03:21:05.691279 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-3a74705c-50d2-486d-8c65-6df6011bf122 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.692846 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-3a74705c-50d2-486d-8c65-6df6011bf122 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1097 time: 0.0558164 Nov 16 03:21:05.757746 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-64794d20-520d-4330-bc50-69accbf44aa7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 217 time: 0.0453575 Nov 16 03:21:05.761743 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-7e815834-e903-4387-8cc2-aed06f74e5d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.763285 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-7e815834-e903-4387-8cc2-aed06f74e5d1 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.1995771 Nov 16 03:21:05.842789 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:05.843705 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-469b0f8a-fe45-4ef8-9b9b-797a2f78492f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.844429 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-469b0f8a-fe45-4ef8-9b9b-797a2f78492f service neutron] 10.222.0.11 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 914 time: 0.2819257 Nov 16 03:21:05.860854 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-81ad7ef6-0c51-4988-b4c7-7396777325d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.863585 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-81ad7ef6-0c51-4988-b4c7-7396777325d7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.0919175 Nov 16 03:21:05.926389 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-aaeaae25-7045-42a0-b034-ffcc7ccd6cf6 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b HTTP/1.1" status: 200 len: 217 time: 0.0694184 Nov 16 03:21:05.926722 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-f35edcb5-8d8c-4704-9f6e-a6901168b9f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.928216 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-f35edcb5-8d8c-4704-9f6e-a6901168b9f3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0574510 Nov 16 03:21:05.940479 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-9106d81d-0ac3-4c12-9fac-639c959f4ac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:05.942189 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-9106d81d-0ac3-4c12-9fac-639c959f4ac6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1673930 Nov 16 03:21:05.950912 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:06.057765 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-85126c70-4d53-4e0d-94e5-920c716e53dd service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1062875 Nov 16 03:21:06.236019 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-5e69acc2-ac36-4137-acea-3b78d84ce70f req-19e510b3-a31f-46fc-9ae4-4e85578b10ab service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1701598 Nov 16 03:21:06.314349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-e44a856d-1048-42aa-a93e-73b7d21abd05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:06.316099 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-e44a856d-1048-42aa-a93e-73b7d21abd05 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=eb17dc2c-fa73-481e-b845-85a7c8e8df27 HTTP/1.1" status: 200 len: 853 time: 0.3708277 Nov 16 03:21:06.360720 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0c16f0fe-3aee-428d-bd8d-aec652437f92 req-e84fe165-96c5-4eae-ada1-65ba7b8f4d63 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 210 time: 0.0407157 Nov 16 03:21:06.395408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:06.402725 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-aa4f18e1-b9ac-4c33-88b8-b431c202368d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b79535bc-1164-4d3a-bbe9-6176a19d036c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0344045 Nov 16 03:21:06.442857 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-8b5ada95-3c46-4248-a08b-572c2fa32c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:06.444734 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-8b5ada95-3c46-4248-a08b-572c2fa32c72 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1097 time: 0.0710850 Nov 16 03:21:06.467731 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-c2cf4304-4457-4588-9072-b13ca512be42 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5069535 Nov 16 03:21:06.505506 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Network 9af16874-689f-4be5-82a5-a21abe98a824 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:21:06.540599 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:21:06.574582 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:21:06.577074 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-18ccf8e0-0aac-4bf1-952e-a1ce326418d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:06.579612 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-18ccf8e0-0aac-4bf1-952e-a1ce326418d4 service neutron] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 915 time: 0.1160328 Nov 16 03:21:06.612836 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:06.625310 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-66bc748a-f0b1-4f66-b7ea-1a901210f440 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 217 time: 0.0374210 Nov 16 03:21:06.648804 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.649144 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.649500 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.649839 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.650164 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.650490 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.650812 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.651136 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.651457 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.651778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.652096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.652410 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:21:06.702306 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:06.703016 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:06.745815 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accb337c-1e26-47a9-ba28-9eba8867dc0e req-8183bfbf-e8d3-4c5d-8935-85dba4503c04 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:06.747524 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-accb337c-1e26-47a9-ba28-9eba8867dc0e req-8183bfbf-e8d3-4c5d-8935-85dba4503c04 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 944 time: 0.2495809 Nov 16 03:21:06.754587 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-3e2e03ca-c618-4127-8813-2e138b5ea5b4 service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3387973 Nov 16 03:21:06.784984 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-82a4635f-7287-4b19-8e78-7fbd0b2326a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0205905 Nov 16 03:21:06.787193 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-599cb2b2-8fbf-4f35-bb77-4009cecacaca service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2837565 Nov 16 03:21:06.836349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Request body: {'port': {'device_id': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:06.846031 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-b9c15cbe-d05d-49ee-a224-f1c2a4c7375d None None] Provisioning complete for port c8dba4d7-4e08-40c8-a119-0e68144a64b1 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:21:06.847107 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b9c15cbe-d05d-49ee-a224-f1c2a4c7375d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:06.904827 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-b9c15cbe-d05d-49ee-a224-f1c2a4c7375d None None] Port c8dba4d7-4e08-40c8-a119-0e68144a64b1 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:21:06.911731 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-accb337c-1e26-47a9-ba28-9eba8867dc0e req-1e146ad5-9c9d-4029-b133-084fea466551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1483450 Nov 16 03:21:06.950763 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:06.965194 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c37e366a-75ca-4967-bbe0-5f5ca9f9b9ad req-7affa2a0-26ff-4687-a9f2-8a8fd5edf380 service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1982520 Nov 16 03:21:07.024905 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-d65b4bec-00c1-4aef-83ca-404df4e6654c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:07.026637 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-d65b4bec-00c1-4aef-83ca-404df4e6654c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.3920820 Nov 16 03:21:07.106291 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-d5c8b8b6-e230-47ca-adb6-09c71af9e902 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:07.108781 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-d5c8b8b6-e230-47ca-adb6-09c71af9e902 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0526123 Nov 16 03:21:07.238731 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-cd3909f7-b336-473f-bb72-14d9479d6760 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1205180 Nov 16 03:21:07.263833 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c8dba4d7-4e08-40c8-a119-0e68144a64b1 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:21:07.274533 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:07.292430 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Transition to ACTIVE for port object c8dba4d7-4e08-40c8-a119-0e68144a64b1 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:21:07.307786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:07.355009 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-649337a9-b2ff-4b97-9402-ab2350c22e46 req-9c9b9e1b-4b94-456f-8c2e-46c84930490b service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1042514 Nov 16 03:21:07.369342 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:07.520435 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Attempting to bind port c8dba4d7-4e08-40c8-a119-0e68144a64b1 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:21:07.520771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Attempting to bind port c8dba4d7-4e08-40c8-a119-0e68144a64b1 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:21:07.521093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Attempting to bind port c8dba4d7-4e08-40c8-a119-0e68144a64b1 on network 9af16874-689f-4be5-82a5-a21abe98a824 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:21:07.531369 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Port c8dba4d7-4e08-40c8-a119-0e68144a64b1 on network 9af16874-689f-4be5-82a5-a21abe98a824 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:21:07.531692 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Attempting to bind port c8dba4d7-4e08-40c8-a119-0e68144a64b1 on network 9af16874-689f-4be5-82a5-a21abe98a824 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:21:07.544043 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26b8aad-1758-47d9-a245-e5b284ed2e8d req-cbb08f30-2c53-4115-9d54-3ab1410dd99a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:07.546018 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d26b8aad-1758-47d9-a245-e5b284ed2e8d req-cbb08f30-2c53-4115-9d54-3ab1410dd99a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0914001 Nov 16 03:21:07.549664 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 21, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:21:07.550220 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Checking segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:21:07.550825 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Bound using segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:21:07.551656 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Bound port: c8dba4d7-4e08-40c8-a119-0e68144a64b1, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:21:07.551795 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:07.661856 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d26b8aad-1758-47d9-a245-e5b284ed2e8d req-33c3d052-6df3-4229-9a1a-eb83210a8e3a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0953131 Nov 16 03:21:07.666989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:21:07.670744 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:21:07.677584 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:07.738488 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:07.739258 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:07.742316 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] 10.222.0.11 "PUT /v2.0/ports/c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 1094 time: 0.9101627 Nov 16 03:21:07.742878 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:07.751438 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fbf8796a-f01a-4e4c-aaa3-68b55b181782" -d '{"events": [{"name": "network-changed", "server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:07.812273 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08164037-70ca-4f53-9bb5-f106820552cc service neutron] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:07.841050 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27d7b990-e4bd-434e-a19f-e6638ab48f69 x-openstack-request-id: req-27d7b990-e4bd-434e-a19f-e6638ab48f69 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:07.842422 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:07.842700 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-27d7b990-e4bd-434e-a19f-e6638ab48f69 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:07.843129 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'status': 'completed', 'code': 200} Nov 16 03:21:07.875420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-f7a8a853-930b-40e1-a3cb-e654ebe2b846 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:07.876964 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-f7a8a853-930b-40e1-a3cb-e654ebe2b846 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1097 time: 0.0495625 Nov 16 03:21:07.945363 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-8a90e5ab-adc2-4e62-8cd8-17062189eeb1 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 217 time: 0.0457983 Nov 16 03:21:08.043355 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-a8e39cc4-74e3-4ef6-86ab-720b8dfe3850 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:08.044807 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-a8e39cc4-74e3-4ef6-86ab-720b8dfe3850 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0920944 Nov 16 03:21:08.073397 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17bcec11-5c33-4876-8c0c-6f2690e00b3f req-a04d1289-fd0b-4d82-a832-f1e0c8359f92 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:08.075244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17bcec11-5c33-4876-8c0c-6f2690e00b3f req-a04d1289-fd0b-4d82-a832-f1e0c8359f92 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 944 time: 0.0682213 Nov 16 03:21:08.144375 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17bcec11-5c33-4876-8c0c-6f2690e00b3f req-969bc619-6711-4b3d-8051-8a5a5bf385d1 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621448 Nov 16 03:21:08.848137 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a914a8-cbbf-4d50-8cfe-c1e1e1958e51 req-419f8e3b-c5fa-43d8-b763-7d420480dedc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:08.850882 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c8a914a8-cbbf-4d50-8cfe-c1e1e1958e51 req-419f8e3b-c5fa-43d8-b763-7d420480dedc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0742254 Nov 16 03:21:08.926733 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c8a914a8-cbbf-4d50-8cfe-c1e1e1958e51 req-f26a17a7-4fcf-43ae-b923-23c486716250 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0687699 Nov 16 03:21:09.271885 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2892ee40-832c-4628-9d3d-e141b84c6218 req-46651c85-4054-4ed5-8812-627914fb61fe tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:09.273589 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2892ee40-832c-4628-9d3d-e141b84c6218 req-46651c85-4054-4ed5-8812-627914fb61fe tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 944 time: 0.0555265 Nov 16 03:21:09.328350 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2892ee40-832c-4628-9d3d-e141b84c6218 req-20c61163-f267-4806-a600-fc65c986bc7f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479312 Nov 16 03:21:09.790187 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 373f70dc-3a64-458a-a38c-adab3f4f3275 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:21:09.904809 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:09.920666 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'port_id': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'mac_address': 'fa:16:3e:2f:ef:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 337, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:21:09.961679 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:09.978942 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 373f70dc-3a64-458a-a38c-adab3f4f3275 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:21:10.002048 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:10.009293 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:10.067794 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f5d405-81f0-433a-95e3-001f3fedbebd req-c5047a90-a755-4695-a8e5-246ffa294716 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:10.069645 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23f5d405-81f0-433a-95e3-001f3fedbebd req-c5047a90-a755-4695-a8e5-246ffa294716 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0619557 Nov 16 03:21:10.070657 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:10.134094 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23f5d405-81f0-433a-95e3-001f3fedbebd req-92d10f9a-8e31-4dd7-86bf-5c00168c2c15 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563054 Nov 16 03:21:10.470268 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7a0e7a-86ba-4f1c-bc4f-d0749b29909b req-3c0730b3-c08b-4fd5-bb74-851d5a5a2ed7 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:10.473130 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9f7a0e7a-86ba-4f1c-bc4f-d0749b29909b req-3c0730b3-c08b-4fd5-bb74-851d5a5a2ed7 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 945 time: 0.0708113 Nov 16 03:21:10.535009 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9f7a0e7a-86ba-4f1c-bc4f-d0749b29909b req-d6b6a535-9c34-41c1-a834-28191380afc9 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533340 Nov 16 03:21:10.812159 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-c1d22b02-486a-4570-85b7-66a2990b1874 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:10.814026 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-c1d22b02-486a-4570-85b7-66a2990b1874 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0550442 Nov 16 03:21:10.936373 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-ea6aec22-caa1-4569-8cc5-e5131b6d739c service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1105638 Nov 16 03:21:11.039983 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-941f5797-6f7a-4667-8243-ab9d52c30f13 req-76f62261-8c0f-4c4e-8396-9ed7d0f42fbd service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0935087 Nov 16 03:21:11.111213 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['373f70dc-3a64-458a-a38c-adab3f4f3275'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:21:11.256715 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-5ab0d065-090e-46b1-a353-05c6ee33b7a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:11.258401 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-5ab0d065-090e-46b1-a353-05c6ee33b7a0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1097 time: 0.0813754 Nov 16 03:21:11.282501 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37515aee-735a-43b7-8b2b-db07a80c128e req-54097dea-114c-44ab-93ec-f81abb92839d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:11.284474 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-37515aee-735a-43b7-8b2b-db07a80c128e req-54097dea-114c-44ab-93ec-f81abb92839d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0573983 Nov 16 03:21:11.335234 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-37515aee-735a-43b7-8b2b-db07a80c128e req-08209184-8766-4dfa-a869-ccb994a7abfc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444093 Nov 16 03:21:11.684923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b13c056-3493-4a7a-be43-57dd07016f76 req-74e17bc6-daef-42fd-8b57-ec2071f255ed tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:11.686773 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9b13c056-3493-4a7a-be43-57dd07016f76 req-74e17bc6-daef-42fd-8b57-ec2071f255ed tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 945 time: 0.0623417 Nov 16 03:21:11.739684 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9b13c056-3493-4a7a-be43-57dd07016f76 req-db1ec9cf-42e2-4023-8ce9-e09e0602b7d6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465405 Nov 16 03:21:12.471778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1a9615-9ba5-4aa8-a019-7575c0d82730 req-77f1b37e-02b3-4651-9e79-9268c886b228 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:12.473395 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f1a9615-9ba5-4aa8-a019-7575c0d82730 req-77f1b37e-02b3-4651-9e79-9268c886b228 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0587070 Nov 16 03:21:12.531876 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f1a9615-9ba5-4aa8-a019-7575c0d82730 req-0d099519-7a41-4539-bf56-4b303fb536e3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476904 Nov 16 03:21:12.879756 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5754b5-de14-4ff5-906a-eb96a3dba739 req-0230ed2f-fcdc-4870-9b43-31d98e370f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:12.881417 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0e5754b5-de14-4ff5-906a-eb96a3dba739 req-0230ed2f-fcdc-4870-9b43-31d98e370f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 945 time: 0.0644243 Nov 16 03:21:12.967823 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0e5754b5-de14-4ff5-906a-eb96a3dba739 req-3a3c94e4-30c2-4672-a784-4c887048b1cd tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775795 Nov 16 03:21:13.662775 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07525bd3-3579-4b77-81e4-81a28f1524bf req-7b672196-3b7b-416a-bdb7-6809c80621de tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:13.664409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-07525bd3-3579-4b77-81e4-81a28f1524bf req-7b672196-3b7b-416a-bdb7-6809c80621de tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0536485 Nov 16 03:21:13.722941 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-07525bd3-3579-4b77-81e4-81a28f1524bf req-f32c5388-c5be-4cbf-8fdb-ad43f9406403 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511079 Nov 16 03:21:14.163452 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d763eb-568e-4bb2-9a52-ff6770b8250a req-a04e1deb-9373-42ac-9973-601a12e9f1ba tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:14.164934 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-21d763eb-568e-4bb2-9a52-ff6770b8250a req-a04e1deb-9373-42ac-9973-601a12e9f1ba tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 945 time: 0.1158133 Nov 16 03:21:14.214470 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-b6338492-09fb-46ab-a748-6355246704f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:14.215960 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-b6338492-09fb-46ab-a748-6355246704f9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.1371095 Nov 16 03:21:14.274120 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-a9873136-8117-4b4d-9ad1-2d887de4c659 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 217 time: 0.0454998 Nov 16 03:21:14.282244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-21d763eb-568e-4bb2-9a52-ff6770b8250a req-379101d2-e135-452c-b972-cabfcad2d6ec tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1036344 Nov 16 03:21:14.359332 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6f8ac381-bf71-4b0a-8bd1-992eab5a9f71 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:14.361401 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-25b1dcb0-fa3e-4ee4-9f30-84de6efb3968 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:14.364082 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-25b1dcb0-fa3e-4ee4-9f30-84de6efb3968 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0806866 Nov 16 03:21:14.423609 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-950a0aa6-c977-4666-8afc-81c35317ab5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:14.425729 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-950a0aa6-c977-4666-8afc-81c35317ab5a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0532646 Nov 16 03:21:14.543575 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-5f35d744-35cd-4472-ab4c-d7618f024433 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1093936 Nov 16 03:21:14.668689 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbf8796a-f01a-4e4c-aaa3-68b55b181782 req-57367927-1535-4955-8299-684b2d5b8a4e service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047714 Nov 16 03:21:14.873370 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991d83eb-1deb-411c-86d7-355ffc675084 req-89231f39-736b-45da-90d1-b645b83a1308 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:14.875019 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-991d83eb-1deb-411c-86d7-355ffc675084 req-89231f39-736b-45da-90d1-b645b83a1308 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0607064 Nov 16 03:21:14.933038 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-991d83eb-1deb-411c-86d7-355ffc675084 req-44404835-eac5-44a7-b713-5285304fb5bd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511010 Nov 16 03:21:15.457635 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ed9be9-efb8-41d0-8b2a-9e563ff7592d req-308f9c11-d24e-4fb1-8326-0c0d9f76092f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:15.459620 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e2ed9be9-efb8-41d0-8b2a-9e563ff7592d req-308f9c11-d24e-4fb1-8326-0c0d9f76092f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 945 time: 0.0670927 Nov 16 03:21:15.516013 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e2ed9be9-efb8-41d0-8b2a-9e563ff7592d req-87e3e5f5-a365-402f-9cd6-dc6d79400d5a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498285 Nov 16 03:21:16.100308 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c8b2c1-9104-4be9-b77d-fc627cc1ef37 req-617b6674-e985-4a8f-aa4c-f4c77ab11612 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:16.101967 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8c8b2c1-9104-4be9-b77d-fc627cc1ef37 req-617b6674-e985-4a8f-aa4c-f4c77ab11612 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0694222 Nov 16 03:21:16.189406 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:21:16.197253 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a8c8b2c1-9104-4be9-b77d-fc627cc1ef37 req-d84d741c-ae80-433f-85b5-7edeadeac9d9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794277 Nov 16 03:21:16.207279 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 373f70dc-3a64-458a-a38c-adab3f4f3275 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:21:16.338766 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 373f70dc-3a64-458a-a38c-adab3f4f3275 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:21:16.351752 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 373f70dc-3a64-458a-a38c-adab3f4f3275 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:21:16.352087 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:16.540561 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:16.563868 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'mac_address': 'fa:16:3e:c6:a7:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:21:16.620569 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:16.671032 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c8dba4d7-4e08-40c8-a119-0e68144a64b1 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:21:16.692923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b5d856-ae80-4530-9558-be9e6e13cc1f req-4c89c57a-aae1-4699-a2d0-09166dbf0939 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:16.694585 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b4b5d856-ae80-4530-9558-be9e6e13cc1f req-4c89c57a-aae1-4699-a2d0-09166dbf0939 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 945 time: 0.0700948 Nov 16 03:21:16.708616 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:16.724894 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:16.745925 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:16.763221 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:16.767317 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11651118-0307-4a9d-9bec-1b4f60555f3e" -d '{"events": [{"server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "name": "network-vif-plugged", "status": "completed", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:16.771486 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b4b5d856-ae80-4530-9558-be9e6e13cc1f req-d40a284a-931c-42f7-b2ea-d23d13737b03 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656285 Nov 16 03:21:16.828517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:16.843053 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3ed4cd6-9d73-433d-8232-1e78ca4e8f55 x-openstack-request-id: req-f3ed4cd6-9d73-433d-8232-1e78ca4e8f55 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:16.843498 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "name": "network-vif-plugged", "status": "completed", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:16.843876 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f3ed4cd6-9d73-433d-8232-1e78ca4e8f55 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:16.844482 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'code': 200} Nov 16 03:21:16.849817 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:16.880624 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:16.956771 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:17.344407 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efa1da7-36a7-418b-a1de-552aa35ae513 req-92c6c864-9742-49bc-83ba-7e56c24ec040 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:17.346142 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4efa1da7-36a7-418b-a1de-552aa35ae513 req-92c6c864-9742-49bc-83ba-7e56c24ec040 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0571449 Nov 16 03:21:17.414674 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4efa1da7-36a7-418b-a1de-552aa35ae513 req-6c994bcf-e2c5-4520-9487-493ed815ea1e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0577078 Nov 16 03:21:17.909067 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bac2dd-a5e4-4661-8368-0b6235661dd9 req-a44b8713-b32e-4b7d-81c9-be8498f633c4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:17.911491 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13bac2dd-a5e4-4661-8368-0b6235661dd9 req-a44b8713-b32e-4b7d-81c9-be8498f633c4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0568643 Nov 16 03:21:17.979848 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13bac2dd-a5e4-4661-8368-0b6235661dd9 req-4998375f-6d98-4ca6-a4d7-267dce5de628 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614438 Nov 16 03:21:18.445563 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-23c887a3-34df-4864-883c-c7029ad925ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:18.580196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fb310a-3dae-4068-908c-2385d9c1b000 req-2b3dd136-3630-493b-9f27-56951bca5dd4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:18.582161 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f2fb310a-3dae-4068-908c-2385d9c1b000 req-2b3dd136-3630-493b-9f27-56951bca5dd4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0562837 Nov 16 03:21:18.657180 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f2fb310a-3dae-4068-908c-2385d9c1b000 req-a6dd44db-0df7-4bd4-a49f-fb321d0fca68 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0639620 Nov 16 03:21:19.130052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e59c26-7b7c-4db5-8b3a-df32f21ce59f req-1c9cde0c-d90c-42e2-a3ac-46e4cd67f814 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:19.131697 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b4e59c26-7b7c-4db5-8b3a-df32f21ce59f req-1c9cde0c-d90c-42e2-a3ac-46e4cd67f814 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0688739 Nov 16 03:21:19.206411 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b4e59c26-7b7c-4db5-8b3a-df32f21ce59f req-5f6b51c7-fc64-45e6-8bb5-a8d48bd829f1 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623715 Nov 16 03:21:19.380868 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253056f3-ce88-4f33-acd0-a876c8f00e6a req-3c31edd9-9e48-421b-b99c-701b7d060ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:19.382800 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-253056f3-ce88-4f33-acd0-a876c8f00e6a req-3c31edd9-9e48-421b-b99c-701b7d060ebd service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1099 time: 0.0556405 Nov 16 03:21:19.440643 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-253056f3-ce88-4f33-acd0-a876c8f00e6a req-c19f61b4-cf87-4803-8d8b-4d34eccef317 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497537 Nov 16 03:21:19.489102 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['c8dba4d7-4e08-40c8-a119-0e68144a64b1'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:21:19.768723 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:19.821408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e373e56a-0f5a-482e-a2c9-2eb06bd8169c req-16ed0c5c-18a2-4b6b-8dd8-f7936629c5e5 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:19.823904 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e373e56a-0f5a-482e-a2c9-2eb06bd8169c req-16ed0c5c-18a2-4b6b-8dd8-f7936629c5e5 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0733058 Nov 16 03:21:19.887314 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e373e56a-0f5a-482e-a2c9-2eb06bd8169c req-5db09d3c-4bf1-4c3e-965b-b201c211b106 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0552452 Nov 16 03:21:20.384880 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c3c5e3-288e-4680-9dab-66c345f05e05 req-e4d180da-d2fe-4c83-a2e7-ad5efab9974d tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:20.387860 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a5c3c5e3-288e-4680-9dab-66c345f05e05 req-e4d180da-d2fe-4c83-a2e7-ad5efab9974d tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0981953 Nov 16 03:21:20.453375 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a5c3c5e3-288e-4680-9dab-66c345f05e05 req-6b7576ed-5aa3-469d-955a-166926500562 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588770 Nov 16 03:21:21.038446 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260bedc3-d0e7-4300-8267-6b4ad16a3b6c req-082343b1-e9b9-428a-926b-6033ed28bffa tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:21.040061 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-260bedc3-d0e7-4300-8267-6b4ad16a3b6c req-082343b1-e9b9-428a-926b-6033ed28bffa tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0551331 Nov 16 03:21:21.097509 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-260bedc3-d0e7-4300-8267-6b4ad16a3b6c req-80454195-a863-4bf8-aa10-ab58b209c5ec tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500510 Nov 16 03:21:21.494908 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:21.609487 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4033742-7aa6-42b8-99cb-35b1a6079e70 req-f85d8d0c-bd21-4334-b568-3595dc7295cf tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:21.612253 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4033742-7aa6-42b8-99cb-35b1a6079e70 req-f85d8d0c-bd21-4334-b568-3595dc7295cf tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0665376 Nov 16 03:21:21.616307 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:21.682403 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4033742-7aa6-42b8-99cb-35b1a6079e70 req-0014d111-2a23-45ab-be01-03cbac715a6b tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566378 Nov 16 03:21:21.864638 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd66565-ff87-478c-8c51-2e6cc09d1102 req-8a22c717-e99b-4e7a-b552-426a436eee37 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:21.867551 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7cd66565-ff87-478c-8c51-2e6cc09d1102 req-8a22c717-e99b-4e7a-b552-426a436eee37 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0814791 Nov 16 03:21:21.947298 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7cd66565-ff87-478c-8c51-2e6cc09d1102 req-1da9a1df-2336-4d65-be90-1a151677cdd2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710354 Nov 16 03:21:22.156620 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:21:22.287768 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d44117b-11cc-409a-8a44-5821fdabf6bf req-298c63dc-b872-444f-a25e-f5a4d009a54c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:22.289491 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8d44117b-11cc-409a-8a44-5821fdabf6bf req-298c63dc-b872-444f-a25e-f5a4d009a54c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0636005 Nov 16 03:21:22.373022 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8d44117b-11cc-409a-8a44-5821fdabf6bf req-acb5c3e9-474a-4f1c-b252-fbb179c7fdc6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0719621 Nov 16 03:21:22.417818 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9754f13-d141-468e-826a-03c489947cbb req-9261f9e9-815e-4fbb-bcdb-5741519d5e24 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:22.419773 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e9754f13-d141-468e-826a-03c489947cbb req-9261f9e9-815e-4fbb-bcdb-5741519d5e24 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0652385 Nov 16 03:21:22.473215 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e9754f13-d141-468e-826a-03c489947cbb req-7d13ef86-5ea6-4f34-8670-749d354ed91a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468421 Nov 16 03:21:22.754650 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:21:22.862335 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port c8dba4d7-4e08-40c8-a119-0e68144a64b1 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:21:22.869122 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port c8dba4d7-4e08-40c8-a119-0e68144a64b1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:21:22.869605 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:22.978750 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:23.004043 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:23.006404 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2a1d843c-b75a-44d0-9724-78271e64a788" -d '{"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-plugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:23.025743 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:23.033126 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:23.062359 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fccbdc21-15a4-4e99-ae83-d37e39ead98b x-openstack-request-id: req-fccbdc21-15a4-4e99-ae83-d37e39ead98b {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:23.062708 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-plugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:23.063093 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-fccbdc21-15a4-4e99-ae83-d37e39ead98b {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:23.063600 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'code': 200} Nov 16 03:21:23.100084 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:23.550597 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada6dd92-c45c-402d-939c-55d84d069431 req-0db526f3-a933-410b-9ef7-f87e4c3141cd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:23.552233 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ada6dd92-c45c-402d-939c-55d84d069431 req-0db526f3-a933-410b-9ef7-f87e4c3141cd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0603304 Nov 16 03:21:23.626909 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ada6dd92-c45c-402d-939c-55d84d069431 req-e5e91a5d-ceea-4aa1-9325-318dcd591a8e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670030 Nov 16 03:21:23.992260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998873d2-993c-4c03-9647-932cc0a35656 req-6bdde755-eb98-40ee-9da2-d777219f3989 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:23.993906 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-998873d2-993c-4c03-9647-932cc0a35656 req-6bdde755-eb98-40ee-9da2-d777219f3989 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1099 time: 0.0513959 Nov 16 03:21:24.057281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-998873d2-993c-4c03-9647-932cc0a35656 req-50865a45-6bf7-4d68-bab2-a621c45c3a55 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496848 Nov 16 03:21:24.786299 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a0455-0d19-4bdc-9e52-fd39e16181d4 req-b073d0cc-d7fa-4cbf-8af9-cbf38712aae3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:24.788120 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-357a0455-0d19-4bdc-9e52-fd39e16181d4 req-b073d0cc-d7fa-4cbf-8af9-cbf38712aae3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0622027 Nov 16 03:21:24.852472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-357a0455-0d19-4bdc-9e52-fd39e16181d4 req-a560b1d1-d1ad-4916-ba71-a57b93aea83f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564930 Nov 16 03:21:26.030703 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b7f739-576f-4ab2-a50d-f29ab8b5f83d req-a0fba01b-762a-41cd-b338-10a51c28e972 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:26.032630 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-08b7f739-576f-4ab2-a50d-f29ab8b5f83d req-a0fba01b-762a-41cd-b338-10a51c28e972 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0761065 Nov 16 03:21:26.088587 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-08b7f739-576f-4ab2-a50d-f29ab8b5f83d req-a347f0c0-a362-455c-b6f2-4e8b6ae5cea0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477977 Nov 16 03:21:27.224050 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27fcce0-59e9-40d6-a01e-fd03677abb6b req-0343ea74-d45e-4066-9479-ff04f607d3d4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:27.225704 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f27fcce0-59e9-40d6-a01e-fd03677abb6b req-0343ea74-d45e-4066-9479-ff04f607d3d4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0551260 Nov 16 03:21:27.279963 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f27fcce0-59e9-40d6-a01e-fd03677abb6b req-0e277108-7755-4cef-8865-d441ea9b93d5 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477607 Nov 16 03:21:28.426644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf8e14c-cd3e-4daf-84f7-a61884bc718a req-8cd0845c-692b-483d-afc4-bb6efffa05b0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:28.428283 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bdf8e14c-cd3e-4daf-84f7-a61884bc718a req-8cd0845c-692b-483d-afc4-bb6efffa05b0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0624011 Nov 16 03:21:28.482521 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bdf8e14c-cd3e-4daf-84f7-a61884bc718a req-dd3c24d2-e584-4c32-a9a9-5683637c676a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477982 Nov 16 03:21:29.661302 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-504973e6-aebc-49a0-bc9e-95dfb47d4ecd req-61e458d6-c6e2-443e-9d70-b5ef6795c265 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:29.663593 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-504973e6-aebc-49a0-bc9e-95dfb47d4ecd req-61e458d6-c6e2-443e-9d70-b5ef6795c265 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0745714 Nov 16 03:21:29.727550 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-504973e6-aebc-49a0-bc9e-95dfb47d4ecd req-8ac76b73-4833-4c4a-95d7-b372c76ca9e2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576656 Nov 16 03:21:30.915066 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d449b07-a61b-4dd2-b61b-1b8117560dc4 req-69dc03df-ce8a-49a3-a355-b366434e706b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:30.917350 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8d449b07-a61b-4dd2-b61b-1b8117560dc4 req-69dc03df-ce8a-49a3-a355-b366434e706b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0575893 Nov 16 03:21:30.978200 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8d449b07-a61b-4dd2-b61b-1b8117560dc4 req-71735395-bb68-4c4c-83a2-d421fa2548d1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540326 Nov 16 03:21:32.147912 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123eb8cc-46d9-4fd4-ac35-4429133f438d req-7346a81a-f4a5-4ec4-a7f6-620bfc89c7bc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:32.149654 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-123eb8cc-46d9-4fd4-ac35-4429133f438d req-7346a81a-f4a5-4ec4-a7f6-620bfc89c7bc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0656672 Nov 16 03:21:32.231628 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-123eb8cc-46d9-4fd4-ac35-4429133f438d req-e533afca-5fe2-4651-b563-77dc26688c39 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731957 Nov 16 03:21:32.376178 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f448088-3a67-47b6-a38a-29bab9c29d16 req-dbc0868c-17f7-4397-9a4d-8b5ab9033c58 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:32.378001 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f448088-3a67-47b6-a38a-29bab9c29d16 req-dbc0868c-17f7-4397-9a4d-8b5ab9033c58 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0614629 Nov 16 03:21:32.390071 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47564) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:32.395181 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'floatingip': {'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:32.491015 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:33.109285 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:33.116496 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:33.300183 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.l3_db [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Floating IP 13eb19b9-ca5d-492e-b510-67de784326d3 associated. External IP: 172.27.1.105, port: c8dba4d7-4e08-40c8-a119-0e68144a64b1. Nov 16 03:21:33.551362 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:21:33.701837 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:21:33.707358 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:33.722746 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:21:33.743214 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-fdb85e47-a169-4d78-bd83-46e88fd94ae1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "PUT /v2.0/floatingips/13eb19b9-ca5d-492e-b510-67de784326d3 HTTP/1.1" status: 200 len: 992 time: 1.3517609 Nov 16 03:21:33.743664 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:21:33.744068 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:33.745759 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:21:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:33.746643 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3890cd1-ffc8-4801-b9b2-93773c77a163" -d '{"events": [{"name": "network-changed", "server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:33.834353 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c7bcd0f-de75-4745-a03a-124e0fe4d73d x-openstack-request-id: req-6c7bcd0f-de75-4745-a03a-124e0fe4d73d {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:33.834506 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:33.834799 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-6c7bcd0f-de75-4745-a03a-124e0fe4d73d {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:33.835840 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'status': 'completed', 'code': 200} Nov 16 03:21:33.962353 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-33c23ca0-6c24-497e-a58e-5ff7dc77d35a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:33.964718 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-33c23ca0-6c24-497e-a58e-5ff7dc77d35a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1099 time: 0.0695896 Nov 16 03:21:33.967330 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:21:34.136744 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-a4627327-2c48-4a54-a965-b83a4ec339ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:34.139821 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-a4627327-2c48-4a54-a965-b83a4ec339ab service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.1659465 Nov 16 03:21:34.287401 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-fdad19fb-baa7-4538-a845-d96161d5b4ed service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 1000 time: 0.1339180 Nov 16 03:21:34.330118 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '13eb19b9-ca5d-492e-b510-67de784326d3', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'mac_address': 'fa:16:3e:c6:a7:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:20:47Z', 'updated_at': '2021-11-16T03:21:32Z', 'revision_number': 1, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:34.364831 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:21:34.375903 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:21:34.376646 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:21:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:34.573143 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:21:34.705062 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-38465edb-7755-4ebb-915b-28b917206e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:34.707115 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-38465edb-7755-4ebb-915b-28b917206e4c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.4059095 Nov 16 03:21:34.802583 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-d0e2798a-aea6-45a3-972d-db424915e74a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:34.806271 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-d0e2798a-aea6-45a3-972d-db424915e74a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0890486 Nov 16 03:21:34.923971 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '13eb19b9-ca5d-492e-b510-67de784326d3', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'mac_address': 'fa:16:3e:c6:a7:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:20:47Z', 'updated_at': '2021-11-16T03:21:32Z', 'revision_number': 1, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:34.953991 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-af226aad-11d5-43d4-b877-5636e3d75da0 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1351540 Nov 16 03:21:35.008188 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf3aa328-9a0e-4845-bf0e-ebd5b6ab08b5 None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '13eb19b9-ca5d-492e-b510-67de784326d3', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'mac_address': 'fa:16:3e:c6:a7:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:20:47Z', 'updated_at': '2021-11-16T03:21:32Z', 'revision_number': 1, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:21:35.068820 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47626) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:35.093781 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3890cd1-ffc8-4801-b9b2-93773c77a163 req-e669c610-c5ba-4bcb-982f-e93fa5b8a00c service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1313047 Nov 16 03:21:35.254505 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32bd6b26-99a7-4f29-baef-379d1a1bbc79 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.276154 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18baee2b-2c70-4476-a169-bca54c921b78 None None] New status for floating IP 13eb19b9-ca5d-492e-b510-67de784326d3: ACTIVE {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:21:35.366009 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32bd6b26-99a7-4f29-baef-379d1a1bbc79 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.370799 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32bd6b26-99a7-4f29-baef-379d1a1bbc79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.409291 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-32bd6b26-99a7-4f29-baef-379d1a1bbc79 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=944e3fb6d9ef45e1a24d3d8c40615a00&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3355381 Nov 16 03:21:35.410870 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 47632) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:35.423784 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bd6b26-99a7-4f29-baef-379d1a1bbc79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5eb1cbe1-4f6a-4c60-9bf4-351c832d17b3,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:35.479767 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9059575-943d-4d82-92ca-bf0aa76bbdd8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.507089 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9059575-943d-4d82-92ca-bf0aa76bbdd8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.567216 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9059575-943d-4d82-92ca-bf0aa76bbdd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.567457 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9059575-943d-4d82-92ca-bf0aa76bbdd8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.572010 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b9059575-943d-4d82-92ca-bf0aa76bbdd8 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/5eb1cbe1-4f6a-4c60-9bf4-351c832d17b3 HTTP/1.1" status: 204 len: 168 time: 0.1598423 Nov 16 03:21:35.582187 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9059575-943d-4d82-92ca-bf0aa76bbdd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5eb1cbe1-4f6a-4c60-9bf4-351c832d17b3,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:35.818749 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:35.929099 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47648) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:35.948632 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a8a976fc-fe41-45c9-99ce-1c3ce8e7e52e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.044519 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a8a976fc-fe41-45c9-99ce-1c3ce8e7e52e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.055843 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a8a976fc-fe41-45c9-99ce-1c3ce8e7e52e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.100175 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a976fc-fe41-45c9-99ce-1c3ce8e7e52e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9078fa4d-02e1-4658-85c4-b189d414f1bc,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:36.106292 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-a8a976fc-fe41-45c9-99ce-1c3ce8e7e52e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=004cbe1fde9049deb6526d1ac73bf596&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1758530 Nov 16 03:21:36.110633 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47654) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:36.172427 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-153d3936-a688-4110-9112-6f277cd0c85d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.203628 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-153d3936-a688-4110-9112-6f277cd0c85d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.255582 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-153d3936-a688-4110-9112-6f277cd0c85d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.258225 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-153d3936-a688-4110-9112-6f277cd0c85d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:36.261393 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-153d3936-a688-4110-9112-6f277cd0c85d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9078fa4d-02e1-4658-85c4-b189d414f1bc HTTP/1.1" status: 204 len: 168 time: 0.1477489 Nov 16 03:21:36.269410 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-153d3936-a688-4110-9112-6f277cd0c85d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9078fa4d-02e1-4658-85c4-b189d414f1bc,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:38.855788 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5b8d54-69a7-49a4-b58a-f90f504b1ddc req-00ce20e1-22df-44a5-bcc1-9ff686f6d4c6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:38.857603 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f5b8d54-69a7-49a4-b58a-f90f504b1ddc req-00ce20e1-22df-44a5-bcc1-9ff686f6d4c6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0596299 Nov 16 03:21:38.917247 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3f5b8d54-69a7-49a4-b58a-f90f504b1ddc req-202e72f9-8594-4d64-bf4a-20f87874be59 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527656 Nov 16 03:21:38.943429 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47718) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:39.223438 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42c5d8ec-5cbb-44b6-b030-7418c00d1cd8 tempest-TestMinimumBasicScenario-1929271014 tempest-TestMinimumBasicScenario-1929271014-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:39.225100 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-42c5d8ec-5cbb-44b6-b030-7418c00d1cd8 tempest-TestMinimumBasicScenario-1929271014 tempest-TestMinimumBasicScenario-1929271014-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1094 time: 0.2805953 Nov 16 03:21:39.230019 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47722) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:39.234997 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'port_id': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'fixed_ip_address': '172.20.0.10'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:39.273288 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for floatingip, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:39.401198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:39.551590 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Allocated IP 172.27.1.100 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/a26e0aa3-8ac4-41b2-afd9-c41c379bb86a) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:21:39.576010 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca02f04-9991-4fa6-9327-351b115c8e5d req-013ab65f-1ffc-47f0-8982-988e011846a7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:39.577782 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aca02f04-9991-4fa6-9327-351b115c8e5d req-013ab65f-1ffc-47f0-8982-988e011846a7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.0783358 Nov 16 03:21:39.640384 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aca02f04-9991-4fa6-9327-351b115c8e5d req-aad3f5be-fe2b-4bab-b4f5-0dcbdac4542c tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552540 Nov 16 03:21:39.677173 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:39.716735 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:39.759148 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:21:39.762125 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:21:39.766554 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:21:39.769877 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'Port': ['ID=a26e0aa3-8ac4-41b2-afd9-c41c379bb86a,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:40.154527 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:40.227414 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:40.391614 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:40.397567 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:40.468811 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'Port': ['ID=a26e0aa3-8ac4-41b2-afd9-c41c379bb86a,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:40.482233 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:40.586750 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.l3_db [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Floating IP be525ef3-de7f-4378-8b15-8328b430b43a associated. External IP: 172.27.1.100, port: 373f70dc-3a64-458a-a38c-adab3f4f3275. Nov 16 03:21:40.848453 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67486a85-a49e-4203-ae5d-5d860aaca965 req-5aef8d8a-a9e8-4649-b7dd-964ef7381e85 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:40.851266 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-67486a85-a49e-4203-ae5d-5d860aaca965 req-5aef8d8a-a9e8-4649-b7dd-964ef7381e85 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.1032047 Nov 16 03:21:40.910954 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-67486a85-a49e-4203-ae5d-5d860aaca965 req-83f01953-a63e-43bd-940f-d03b5e4f86a2 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527353 Nov 16 03:21:41.082889 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:21:41.208321 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:21:41.219241 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] Sync routers for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:21:41.230988 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:21:41.231620 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:21:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:41.235551 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.266436 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3ffb8f83-673f-428d-91cc-83e941bc909a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0352206 Nov 16 03:21:41.267025 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:41.270326 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4" -d '{"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:41.270623 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 47744) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:41.275926 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1683105470', 'description': 'tempest-secgroup-smoke-1683105470 description', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:41.305588 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.327204 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82d7779a-f483-4444-9fd1-d0c16785cb45 x-openstack-request-id: req-82d7779a-f483-4444-9fd1-d0c16785cb45 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:41.327692 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:41.328802 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-82d7779a-f483-4444-9fd1-d0c16785cb45 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:41.329384 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'status': 'completed', 'code': 200} Nov 16 03:21:41.403090 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:21:41.426183 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.432087 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.474414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.475755 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2041864 Nov 16 03:21:41.480451 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 47748) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:41.485411 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group_rule': {'security_group_id': '779f874f-c312-438b-8e31-979b354c2f48', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:41.492983 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe936c8-09a1-4f2c-9dc1-dfd12e6361e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroup': ['ID=779f874f-c312-438b-8e31-979b354c2f48,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:41.526650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.605148 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.610219 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.639855 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=95b4000f-c81b-40fa-a57d-96e26b0f101f,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:41.656049 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.658303 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7e93ed29-3a0b-4d28-948e-50d4e097c865 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1764483 Nov 16 03:21:41.661206 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 47752) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:41.666001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group_rule': {'security_group_id': '779f874f-c312-438b-8e31-979b354c2f48', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:41.698291 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.779450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.785771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.811299 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'be525ef3-de7f-4378-8b15-8328b430b43a', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'floating_ip_address': '172.27.1.100', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'port_id': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 533, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'mac_address': 'fa:16:3e:2f:ef:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:21:40Z', 'updated_at': '2021-11-16T03:21:40Z', 'revision_number': 0, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:41.822222 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=65247bb9-e6e7-44cb-9b97-1a869202a357,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:41.829713 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.836224 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-e12ef6ec-ce52-42aa-bd0e-83365842e253 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1693532 Nov 16 03:21:41.836685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47754) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:41.841957 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group_rule': {'security_group_id': '779f874f-c312-438b-8e31-979b354c2f48', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:41.854176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] Checking router: 0f03a58b-d978-4d06-8b7c-905f27fd0d8a for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:21:41.870150 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:21:41.870794 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:21:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:41.872891 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.959036 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.965389 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:41.996782 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f2414721-a032-4732-ad4c-468d75af0c17,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:42.011720 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.013702 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:21:42.018424 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 47758) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:42.019129 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-493e7394-3b81-4fb9-81ce-7312106df1b4 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1808248 Nov 16 03:21:42.025617 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group_rule': {'security_group_id': '779f874f-c312-438b-8e31-979b354c2f48', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:42.087687 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.118792 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-977043f7-b069-4300-b48c-cdcffc5f9cce req-25cc9472-1acd-440f-abb7-4edaae4f0e52 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:42.120901 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-977043f7-b069-4300-b48c-cdcffc5f9cce req-25cc9472-1acd-440f-abb7-4edaae4f0e52 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.0863922 Nov 16 03:21:42.199042 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.203861 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-977043f7-b069-4300-b48c-cdcffc5f9cce req-a05241a6-61a6-4081-be23-f4c1a6a65f77 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737526 Nov 16 03:21:42.206564 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.231215 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f306f88e-0a4d-4f2f-af2d-d1f22be3e223,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:42.240170 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.241804 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-5c1cbe44-12e9-4bc1-9b98-e8822489a195 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2216580 Nov 16 03:21:42.245960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 47760) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:42.250824 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group_rule': {'security_group_id': '779f874f-c312-438b-8e31-979b354c2f48', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:42.274949 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.securitygroups_db [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Project 76754ec1f4b143ceabbcb17af1aa513b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 16 03:21:42.280915 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.324092 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'be525ef3-de7f-4378-8b15-8328b430b43a', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'floating_ip_address': '172.27.1.100', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'port_id': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 533, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'mac_address': 'fa:16:3e:2f:ef:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:21:40Z', 'updated_at': '2021-11-16T03:21:40Z', 'revision_number': 0, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:21:42.354768 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-506400f6-7271-4f1e-bf0e-57b6295e9b18 None None] The sync data for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi is: [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'be525ef3-de7f-4378-8b15-8328b430b43a', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'floating_ip_address': '172.27.1.100', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'port_id': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 533, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'mac_address': 'fa:16:3e:2f:ef:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:21:40Z', 'updated_at': '2021-11-16T03:21:40Z', 'revision_number': 0, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:21:42.361452 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.366273 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.391001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4223cac6-5231-4488-932b-1692fd25221e,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:42.404956 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.411864 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 47762) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:21:42.412474 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-76cca185-5dd5-4ef0-a222-2d919fe12065 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1650593 Nov 16 03:21:42.417347 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'security_group_rule': {'security_group_id': '779f874f-c312-438b-8e31-979b354c2f48', 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:42.451087 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.securitygroups_db [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Project 76754ec1f4b143ceabbcb17af1aa513b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 16 03:21:42.457325 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.552170 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.561089 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.582411 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=74d86708-8d3a-4e29-84fa-08c26ab15c68,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:42.584355 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9f85960-515d-4495-a4a2-1a717c944865 None None] New status for floating IP be525ef3-de7f-4378-8b15-8328b430b43a: ACTIVE {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:21:42.593749 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.595144 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3af12c8b-b91f-4fea-9bcc-e3098f1c0f80 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1813309 Nov 16 03:21:42.697704 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-9cdd4d48-f44e-4c5c-83b2-484c3982ff60 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1683105470&fields=id&tenant_id=76754ec1f4b143ceabbcb17af1aa513b HTTP/1.1" status: 200 len: 267 time: 0.0528817 Nov 16 03:21:42.792999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-a4943342-b2ad-4317-9f1d-b3c05cb5d2c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:42.794656 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-a4943342-b2ad-4317-9f1d-b3c05cb5d2c0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1099 time: 0.0898681 Nov 16 03:21:42.809154 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-306e7a42-0365-4b12-b99d-1b2c30b9de4f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:42.810925 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-306e7a42-0365-4b12-b99d-1b2c30b9de4f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0970113 Nov 16 03:21:42.837169 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'port': {'security_groups': ['baadeb48-7237-4752-a8bf-62e69b7ab85b', '779f874f-c312-438b-8e31-979b354c2f48']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:21:42.959754 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:42.983766 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-9b4f2985-6967-4cc7-ae66-92143e57401c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:42.985421 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-9b4f2985-6967-4cc7-ae66-92143e57401c service neutron] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 915 time: 0.1733346 Nov 16 03:21:43.106461 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-d744ca5b-1e75-42ea-a06f-608c111c5842 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 1002 time: 0.0943201 Nov 16 03:21:43.234167 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-f59216c5-3dd1-49d6-9bf3-be6834186601 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:43.235684 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-f59216c5-3dd1-49d6-9bf3-be6834186601 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.0980861 Nov 16 03:21:43.308450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:43.368735 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:43.377495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:43.380301 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-cc9604d3-b748-46ab-9023-2a5f8214bfb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:43.381853 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-cc9604d3-b748-46ab-9023-2a5f8214bfb3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1322060 Nov 16 03:21:43.416232 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['373f70dc-3a64-458a-a38c-adab3f4f3275'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:21:43.445859 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:43.446604 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:43.448705 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b5a16c9-5079-4adb-86a8-acaf47d1a6e5 req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "PUT /v2.0/ports/373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 982 time: 0.6269956 Nov 16 03:21:43.454570 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:43.454570 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3d78750-a173-4817-92bb-d756ff79c34c" -d '{"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:43.472437 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e9e8fa-1e78-4018-b948-4245f3202859 req-ab08c294-2bc4-4547-a979-9613c0c2bf01 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:43.474052 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-16e9e8fa-1e78-4018-b948-4245f3202859 req-ab08c294-2bc4-4547-a979-9613c0c2bf01 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.1683946 Nov 16 03:21:43.517139 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-d7bbfd35-7b3d-47f2-9fdf-1c57ac894097 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:43.519121 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-d7bbfd35-7b3d-47f2-9fdf-1c57ac894097 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 945 time: 0.0810492 Nov 16 03:21:43.576186 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4ffa11-7fbb-480e-9cee-dae4d07f8617 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=6']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:43.624848 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['373f70dc-3a64-458a-a38c-adab3f4f3275'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:21:43.686299 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-16e9e8fa-1e78-4018-b948-4245f3202859 req-58855e0d-355e-429b-8731-5d59e701a8f9 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772168 Nov 16 03:21:43.706473 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066bcba0-14a1-40c2-bdbb-38ac7e2beca7 req-927447e5-cef9-4a38-8eb1-2cb9c8fd4ff2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:43.708147 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-066bcba0-14a1-40c2-bdbb-38ac7e2beca7 req-927447e5-cef9-4a38-8eb1-2cb9c8fd4ff2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.1349754 Nov 16 03:21:43.716111 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-84821259-0e6a-4738-a6f6-734016d26d86 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2535722 Nov 16 03:21:43.732895 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Deleting port 28525ffc-1c38-4068-bbad-deeb2fb7501b {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:21:43.733229 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:43.805051 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8b12d6ea-43ff-4edf-8522-d98d18dad2b3 None None] Provisioning complete for port 373f70dc-3a64-458a-a38c-adab3f4f3275 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:21:43.810090 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8b12d6ea-43ff-4edf-8522-d98d18dad2b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:43.864984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f290a639-0c82-4f4d-ae8f-2ffb22f8e8c7 x-openstack-request-id: req-f290a639-0c82-4f4d-ae8f-2ffb22f8e8c7 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:43.865463 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:43.865856 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f290a639-0c82-4f4d-ae8f-2ffb22f8e8c7 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:43.866829 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'status': 'completed', 'code': 200} Nov 16 03:21:43.867368 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] For port 28525ffc-1c38-4068-bbad-deeb2fb7501b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=28525ffc-1c38-4068-bbad-deeb2fb7501b,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:21:43.867824 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:43.886230 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Calling delete_port for 28525ffc-1c38-4068-bbad-deeb2fb7501b owned by compute:nova {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:21:43.952713 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1e8927f7-4fc3-477d-abf3-5d30d8307cc4 req-b9ac46e3-95bb-472c-9e77-82fcc3d56e9e service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2206964 Nov 16 03:21:44.014883 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-066bcba0-14a1-40c2-bdbb-38ac7e2beca7 req-79027832-9753-48c1-ac58-847dc2782467 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2955284 Nov 16 03:21:44.101388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:44.146982 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Pushing event deleted for resources: {'Port': ['ID=28525ffc-1c38-4068-bbad-deeb2fb7501b,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:21:44.165785 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d78750-a173-4817-92bb-d756ff79c34c req-c17d22ad-1f59-4df9-a8c8-9cfb7eaac6bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:44.171319 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-c17d22ad-1f59-4df9-a8c8-9cfb7eaac6bb service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1138 time: 0.0752218 Nov 16 03:21:44.212068 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] No DVR routers for this DVR port 28525ffc-1c38-4068-bbad-deeb2fb7501b on host hv-cinder-81803 {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:21:44.216368 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:44.220156 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-ac0f84ec-bbe3-4a3a-b59d-6a4862a02806 req-12ed52f7-fd30-4131-9e90-deb05f5eb490 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "DELETE /v2.0/ports/28525ffc-1c38-4068-bbad-deeb2fb7501b HTTP/1.1" status: 204 len: 173 time: 0.6904502 Nov 16 03:21:44.222383 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'name': 'network-vif-deleted', 'tag': '28525ffc-1c38-4068-bbad-deeb2fb7501b'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:21:44.229083 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1eff738-ed1e-4cfd-a6a5-3b07100414b3" -d '{"events": [{"server_uuid": "5ed5ed50-c2a1-47a7-a744-23b6c614cfa4", "name": "network-vif-deleted", "tag": "28525ffc-1c38-4068-bbad-deeb2fb7501b"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:21:44.322041 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:21:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b72c8710-f162-45c0-9515-2748ee2edaee x-openstack-request-id: req-b72c8710-f162-45c0-9515-2748ee2edaee {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:21:44.322354 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ed5ed50-c2a1-47a7-a744-23b6c614cfa4", "name": "network-vif-deleted", "tag": "28525ffc-1c38-4068-bbad-deeb2fb7501b", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:21:44.322610 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b72c8710-f162-45c0-9515-2748ee2edaee {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:21:44.323020 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ed5ed50-c2a1-47a7-a744-23b6c614cfa4', 'name': 'network-vif-deleted', 'tag': '28525ffc-1c38-4068-bbad-deeb2fb7501b', 'status': 'completed', 'code': 200} Nov 16 03:21:44.359606 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d78750-a173-4817-92bb-d756ff79c34c req-0472abcb-ab98-4032-89c8-b0da7d47275d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:44.363712 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-0472abcb-ab98-4032-89c8-b0da7d47275d service neutron] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 915 time: 0.1796560 Nov 16 03:21:44.384076 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b82a6c36-1b7d-4868-93df-4ba6856df9e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:44.444658 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-6b1af1cc-2847-43df-ab49-25006494725c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 1002 time: 0.0736244 Nov 16 03:21:44.538394 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d78750-a173-4817-92bb-d756ff79c34c req-787fae22-0b60-41f9-8b6f-bde17f6a0af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:44.539842 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-787fae22-0b60-41f9-8b6f-bde17f6a0af5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.0796938 Nov 16 03:21:44.590585 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d78750-a173-4817-92bb-d756ff79c34c req-4d46b4fc-b0b2-44e2-911d-a6446df918f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:21:44.592112 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-4d46b4fc-b0b2-44e2-911d-a6446df918f2 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438063 Nov 16 03:21:44.811931 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-61957c0c-feda-4faa-9317-b57315df2bbb req-92ca194d-9b13-41b4-bda4-41c837637f3a tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 210 time: 0.0289257 Nov 16 03:21:45.709519 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-673595be-247d-4729-b445-a56fb9f83883 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0948627 Nov 16 03:21:45.927341 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de18f166-47ba-4fb5-b2e1-177d834f3ecf req-c958dc39-e68a-44c5-92fe-4cf11a585f89 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 210 time: 0.0287542 Nov 16 03:21:47.047591 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4f21b2c7-9d92-465b-beb8-53d7e92f8c9d req-9ea28db3-f8b6-4ab8-b1d7-52d6e362b034 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ed5ed50-c2a1-47a7-a744-23b6c614cfa4 HTTP/1.1" status: 200 len: 210 time: 0.0281391 Nov 16 03:21:47.621167 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3d78750-a173-4817-92bb-d756ff79c34c req-d337ad6b-cfd0-440e-b021-41e924ded200 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1076727 Nov 16 03:21:48.444227 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7b845128-f096-4fc6-ada5-d21f735766ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:49.764177 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:50.368944 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 28525ffc-1c38-4068-bbad-deeb2fb7501b no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:21:50.389969 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 28525ffc-1c38-4068-bbad-deeb2fb7501b {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:21:50.390310 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 28525ffc-1c38-4068-bbad-deeb2fb7501b not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:21:51.498320 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:51.602931 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:21:59.136126 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:22:00.509862 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-c48f995d-fd31-4faf-98b4-d470a871018f tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:00.511462 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-c48f995d-fd31-4faf-98b4-d470a871018f tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 813 time: 0.1255956 Nov 16 03:22:00.532213 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-23a60898-fd10-4b76-b529-0b2424058e3b tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/quotas/ec26dd4c49f74ef7b1b41c9d379e7aa6 HTTP/1.1" status: 200 len: 375 time: 0.0113602 Nov 16 03:22:00.567709 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-46d186fd-9288-4af1-bd70-1b83129832fd tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0286732 Nov 16 03:22:00.758017 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-d4f68b70-9ae1-4007-ad93-d7177fea35ea service neutron] 10.222.0.31 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1816514 Nov 16 03:22:00.858214 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-437e30f2-5063-4416-a73b-a663443dbfe0 service neutron] 10.222.0.31 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0937011 Nov 16 03:22:01.085484 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-724a43c2-d1b9-4cd1-86bd-41128477bb56 req-68d5c27f-1361-4b54-9bfa-c110549abb5f tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 210 time: 0.0853393 Nov 16 03:22:02.189308 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1a18f964-6ee0-4861-a314-82ed1580fc7e req-d4d3b70c-be5b-4607-ae40-a82cc3789dc1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 210 time: 0.0346167 Nov 16 03:22:03.292792 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d18212b9-bd93-48f8-8887-452305c87091 req-4d3630de-cc2d-4a61-8a77-f22dc70f32f7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 210 time: 0.0279932 Nov 16 03:22:04.019102 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-255e8214-67fa-4e5b-af71-57d4962df4b9 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0474136 Nov 16 03:22:04.106393 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-7cd776e1-b4bb-4303-a476-4223f8ae0501 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:04.108087 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-7cd776e1-b4bb-4303-a476-4223f8ae0501 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1098 time: 0.0437090 Nov 16 03:22:04.224089 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-3988443e-0b3f-496f-9a34-ea96469614c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:04.225699 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-3988443e-0b3f-496f-9a34-ea96469614c5 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.0932178 Nov 16 03:22:04.300253 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-5fac32bc-6a4b-4ad7-a290-4992771ad713 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1 HTTP/1.1" status: 200 len: 1001 time: 0.0657325 Nov 16 03:22:04.403100 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d5b02ddf-bdc7-4c9d-b7a2-fc9a44c9e4bb req-149337c9-9fe6-418e-b94c-f269e276d50d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 210 time: 0.0355883 Nov 16 03:22:04.409972 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-67febeb7-cabd-456d-afa5-c447a33e9d63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:04.411480 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-67febeb7-cabd-456d-afa5-c447a33e9d63 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0778470 Nov 16 03:22:04.491386 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-4bf8590e-79d3-4ee2-8f82-89e69bc1fe8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:04.492955 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-4bf8590e-79d3-4ee2-8f82-89e69bc1fe8b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0453751 Nov 16 03:22:04.605856 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-4c848ee1-7216-47c1-8cf9-f73a75bd97b3 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1022987 Nov 16 03:22:04.627330 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-582fa5b3-059a-4df8-b7e5-9bb53774c802 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:04.629106 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-582fa5b3-059a-4df8-b7e5-9bb53774c802 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 813 time: 0.1672761 Nov 16 03:22:04.651775 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Request body: {'port': {'device_id': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c', 'admin_state_up': True, 'tenant_id': 'ec26dd4c49f74ef7b1b41c9d379e7aa6'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:22:04.727846 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9231bf12-a22f-4aed-89e3-744c866d5497 req-8b542e3c-a238-48e3-a6cb-188b3ff00715 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0997052 Nov 16 03:22:04.780772 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Made reservation on behalf of ec26dd4c49f74ef7b1b41c9d379e7aa6 for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:22:04.784937 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:04.962769 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Allocated IP 172.20.0.11 (b79535bc-1164-4d3a-bbe9-6176a19d036c/eb17dc2c-fa73-481e-b845-85a7c8e8df27/d31c4daf-2cc8-4a47-9710-52c3d8f62e71) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:22:05.138308 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.177899 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.251742 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Network b79535bc-1164-4d3a-bbe9-6176a19d036c is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:22:05.261567 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:22:05.268728 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:22:05.309802 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Pushing event updated for resources: {'Port': ['ID=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:05.340747 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:05.341412 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.368617 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f37d52fe-cfc7-4a5c-9af2-f298d8598abf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7194889 Nov 16 03:22:05.388219 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Request body: {'port': {'device_id': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:22:05.447302 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.539740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c256fcf-536a-473b-b327-1f6656e628b3 req-6dc4a403-fccf-42b7-96e4-83b530bee6b7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:05.541453 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0c256fcf-536a-473b-b327-1f6656e628b3 req-6dc4a403-fccf-42b7-96e4-83b530bee6b7 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 932 time: 0.0626361 Nov 16 03:22:05.598184 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0c256fcf-536a-473b-b327-1f6656e628b3 req-5642f715-12fd-4d77-b034-62a7725d248d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492921 Nov 16 03:22:05.763229 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d31c4daf-2cc8-4a47-9710-52c3d8f62e71 {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:22:05.771264 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.784670 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Transition to ACTIVE for port object d31c4daf-2cc8-4a47-9710-52c3d8f62e71 will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:22:05.790851 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.819108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:05.848375 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Pushing event updated for resources: {'Port': ['ID=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:05.874607 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.874951 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.875281 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.875609 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.875936 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.876258 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.876577 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.876891 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.877205 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.877566 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.877889 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.878191 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:05.937679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Attempting to bind port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:22:05.938052 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Attempting to bind port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:22:05.938331 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Attempting to bind port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 on network b79535bc-1164-4d3a-bbe9-6176a19d036c {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:22:05.943605 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 on network b79535bc-1164-4d3a-bbe9-6176a19d036c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:22:05.944003 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Attempting to bind port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 on network b79535bc-1164-4d3a-bbe9-6176a19d036c {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:22:05.950205 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 22, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:22:05.950541 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Checking segment: {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:22:05.950907 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Bound using segment: {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:22:05.951344 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Bound port: d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 321, 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:22:05.951698 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:06.024344 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] For port d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:22:06.028392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] For port d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:22:06.035800 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:06.107729 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:06.108724 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:06.110760 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] 10.222.0.11 "PUT /v2.0/ports/d31c4daf-2cc8-4a47-9710-52c3d8f62e71 HTTP/1.1" status: 200 len: 1094 time: 0.7273116 Nov 16 03:22:06.115049 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'tag': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:22:06.116285 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-991f2991-a688-47cc-a730-fb829b44c04e" -d '{"events": [{"name": "network-changed", "server_uuid": "e82b17c5-3261-437a-8359-cb08064fb2c1", "tag": "d31c4daf-2cc8-4a47-9710-52c3d8f62e71"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:22:06.154105 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da0b7bc-67fb-4f35-87e3-41189b7acff2 service neutron] Pushing event updated for resources: {'Port': ['ID=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:06.184437 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:22:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-609f3931-99f2-49e4-aeef-91e18ec3dc2f x-openstack-request-id: req-609f3931-99f2-49e4-aeef-91e18ec3dc2f {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:22:06.185153 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e82b17c5-3261-437a-8359-cb08064fb2c1", "tag": "d31c4daf-2cc8-4a47-9710-52c3d8f62e71", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:22:06.185560 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-609f3931-99f2-49e4-aeef-91e18ec3dc2f {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:22:06.186573 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'tag': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71', 'status': 'completed', 'code': 200} Nov 16 03:22:06.246918 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-0faa126d-b5a5-425c-a613-48b9d968834c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:06.248526 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-0faa126d-b5a5-425c-a613-48b9d968834c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 1097 time: 0.0460699 Nov 16 03:22:06.303344 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-f6ad4cf1-a888-4b1a-8ab9-909d13ffa5cf service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71 HTTP/1.1" status: 200 len: 217 time: 0.0374336 Nov 16 03:22:06.388983 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-8ebe6881-607e-4f65-931d-6775bf9a5a9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:06.390920 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-8ebe6881-607e-4f65-931d-6775bf9a5a9b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=eb17dc2c-fa73-481e-b845-85a7c8e8df27 HTTP/1.1" status: 200 len: 853 time: 0.0692058 Nov 16 03:22:06.437067 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-c0c3976d-9773-465e-94ba-7503b87b005e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b79535bc-1164-4d3a-bbe9-6176a19d036c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0360932 Nov 16 03:22:06.595837 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-e88e0d93-daab-480e-a240-e8903eb2918f service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0968814 Nov 16 03:22:06.712276 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-70fe63ab-fc4d-4354-aead-88a5bbfe1a2c req-fb291af6-7c56-4ef4-a80f-e32ee8ae3a21 service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0992723 Nov 16 03:22:06.727932 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fff0220-64fe-43c7-8679-479893e7a280 req-e1f6a773-d553-4e84-8d4e-d879d7604391 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:06.729487 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9fff0220-64fe-43c7-8679-479893e7a280 req-e1f6a773-d553-4e84-8d4e-d879d7604391 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0519154 Nov 16 03:22:06.778869 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9fff0220-64fe-43c7-8679-479893e7a280 req-99a81ea0-e283-4901-af59-bce42e2d69a1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432751 Nov 16 03:22:07.912185 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2d9097-2b0b-462d-99e3-9ae528b74f16 req-724278f3-6c26-400d-88bd-5c26ce062d01 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:07.913861 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8e2d9097-2b0b-462d-99e3-9ae528b74f16 req-724278f3-6c26-400d-88bd-5c26ce062d01 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0535526 Nov 16 03:22:07.971156 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8e2d9097-2b0b-462d-99e3-9ae528b74f16 req-040a73f3-807f-4a5f-8d1e-836ad5962189 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513692 Nov 16 03:22:09.096978 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50debea4-462b-403c-81d7-179c27a6c82a req-c6f7d7a8-7b5f-48df-83d0-1b6f13b0235e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:09.098492 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-50debea4-462b-403c-81d7-179c27a6c82a req-c6f7d7a8-7b5f-48df-83d0-1b6f13b0235e tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0545747 Nov 16 03:22:09.152418 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-50debea4-462b-403c-81d7-179c27a6c82a req-65f3f79b-7dec-4f1c-b8b3-5714250b096b tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469620 Nov 16 03:22:09.860394 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991f2991-a688-47cc-a730-fb829b44c04e req-517dc807-3225-4ec2-beb1-042afed8a9be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:09.861950 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-517dc807-3225-4ec2-beb1-042afed8a9be service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 1097 time: 0.0477822 Nov 16 03:22:09.963983 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991f2991-a688-47cc-a730-fb829b44c04e req-bacb7a41-2b23-492f-ac77-b2f3b4b98aa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:09.965496 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-bacb7a41-2b23-492f-ac77-b2f3b4b98aa8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 200 len: 914 time: 0.0949876 Nov 16 03:22:10.018259 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-c1ee847f-2c18-4196-b2a2-d1f02ec54a4d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71 HTTP/1.1" status: 200 len: 217 time: 0.0368073 Nov 16 03:22:10.099574 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991f2991-a688-47cc-a730-fb829b44c04e req-1e06b373-0f25-440d-acd5-65aa73477aac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:10.101362 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-1e06b373-0f25-440d-acd5-65aa73477aac service neutron] 10.222.0.11 "GET /v2.0/subnets?id=eb17dc2c-fa73-481e-b845-85a7c8e8df27 HTTP/1.1" status: 200 len: 853 time: 0.0484848 Nov 16 03:22:10.138311 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-d0f53474-e9a8-4a58-aeac-c64c06540bb6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b79535bc-1164-4d3a-bbe9-6176a19d036c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273607 Nov 16 03:22:10.240479 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-c316ae5e-825e-4743-9fb6-7061f87b1b4b service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932765 Nov 16 03:22:10.277228 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6791a7f-f1fd-4949-9d66-c7806ff5428b req-b4ff09e7-d762-4325-80ee-2a5590582b6d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:10.278901 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d6791a7f-f1fd-4949-9d66-c7806ff5428b req-b4ff09e7-d762-4325-80ee-2a5590582b6d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0551004 Nov 16 03:22:10.334935 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d6791a7f-f1fd-4949-9d66-c7806ff5428b req-847f8179-1157-42c9-b6a8-5a7884da152a tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492868 Nov 16 03:22:10.339623 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-991f2991-a688-47cc-a730-fb829b44c04e req-ad7a4743-c6f3-4a2d-90fa-f5604e24647f service neutron] 10.222.0.11 "GET /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895808 Nov 16 03:22:11.458008 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c815af1-94ec-4877-bb48-1b895f4a0b35 req-86cb3f06-8374-47e8-b31c-edb22e8474e1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:11.459548 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1c815af1-94ec-4877-bb48-1b895f4a0b35 req-86cb3f06-8374-47e8-b31c-edb22e8474e1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0544617 Nov 16 03:22:11.510439 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1c815af1-94ec-4877-bb48-1b895f4a0b35 req-083b8e02-b67e-471c-b2a9-486de46313c5 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445569 Nov 16 03:22:12.638486 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfca05b2-0307-4895-955b-f93cb812e456 req-b936c670-de60-4140-bc19-2375b00d49ce tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:12.640000 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cfca05b2-0307-4895-955b-f93cb812e456 req-b936c670-de60-4140-bc19-2375b00d49ce tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0556214 Nov 16 03:22:12.688330 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cfca05b2-0307-4895-955b-f93cb812e456 req-ee6ecc91-1498-4112-be49-64a3402304ce tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422609 Nov 16 03:22:13.629335 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d31c4daf-2cc8-4a47-9710-52c3d8f62e71 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:22:13.737481 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:13.749340 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71', 'network_id': 'b79535bc-1164-4d3a-bbe9-6176a19d036c', 'port_id': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71', 'mac_address': 'fa:16:3e:07:dd:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 321, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb17dc2c-fa73-481e-b845-85a7c8e8df27', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:22:13.787988 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:13.800804 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d31c4daf-2cc8-4a47-9710-52c3d8f62e71 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:22:13.806717 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f639574-857f-4483-9a09-5dd9bb95d955 req-2b39061e-f354-4c7a-be84-55fead800e87 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:13.808256 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7f639574-857f-4483-9a09-5dd9bb95d955 req-2b39061e-f354-4c7a-be84-55fead800e87 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 944 time: 0.0491273 Nov 16 03:22:13.821898 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:13.828124 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:13.861421 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7f639574-857f-4483-9a09-5dd9bb95d955 req-8a701261-8505-489d-813f-4506fd9176b5 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468667 Nov 16 03:22:13.880125 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:13.888784 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.889155 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.889518 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.889909 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.890186 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.891105 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.891105 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.891295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.891583 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.891962 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.892287 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:13.892608 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.212107 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['d31c4daf-2cc8-4a47-9710-52c3d8f62e71'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:22:14.367335 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-24b50770-40be-42ca-942c-51f7d88d0b9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.582867 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48096) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:14.708069 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.794546 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.799891 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.839299 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=cd334af14b4e41ec92a7bd475e344ed3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2550581 Nov 16 03:22:14.840001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd3610ea-2e61-464d-9545-bbfb3ae7f39c,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:14.842020 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48100) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:14.847226 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.847545 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.847912 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.848242 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.848568 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.848894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.849867 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.850199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.850528 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.850851 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.851172 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.851480 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a05d3ce-5958-4a93-96c0-b1a7a10aa524 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:22:14.897218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32c02929-aebb-4dfd-b0ff-3167ee11f780 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.920008 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32c02929-aebb-4dfd-b0ff-3167ee11f780 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.971338 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32c02929-aebb-4dfd-b0ff-3167ee11f780 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.973938 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32c02929-aebb-4dfd-b0ff-3167ee11f780 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:14.975079 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-32c02929-aebb-4dfd-b0ff-3167ee11f780 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/fd3610ea-2e61-464d-9545-bbfb3ae7f39c HTTP/1.1" status: 204 len: 168 time: 0.1320701 Nov 16 03:22:14.986432 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c02929-aebb-4dfd-b0ff-3167ee11f780 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd3610ea-2e61-464d-9545-bbfb3ae7f39c,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:14.990465 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ceded0-4650-407f-bfa7-4bb8dfa82a77 req-c9c23e0a-4dc4-417c-b74a-fb96f1e62888 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:14.993858 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d6ceded0-4650-407f-bfa7-4bb8dfa82a77 req-c9c23e0a-4dc4-417c-b74a-fb96f1e62888 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 945 time: 0.0574987 Nov 16 03:22:15.044016 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d6ceded0-4650-407f-bfa7-4bb8dfa82a77 req-dd866ef7-f80d-461c-8172-cdd03c676901 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450699 Nov 16 03:22:15.266597 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48108) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:15.286970 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-207e7de5-c0ed-4627-bbab-466917404b95 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.371036 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-207e7de5-c0ed-4627-bbab-466917404b95 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.377588 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-207e7de5-c0ed-4627-bbab-466917404b95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.422841 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-207e7de5-c0ed-4627-bbab-466917404b95 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=31f1f0a705c44fbca0558f1e20cb5279&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1548035 Nov 16 03:22:15.423969 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207e7de5-c0ed-4627-bbab-466917404b95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1118cae-23c9-4daf-9971-fe881434c74d,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:15.425626 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48112) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:15.479370 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2913563c-eb17-4fde-a543-1451cd8f3a3d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.506080 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2913563c-eb17-4fde-a543-1451cd8f3a3d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.561113 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2913563c-eb17-4fde-a543-1451cd8f3a3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.563965 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2913563c-eb17-4fde-a543-1451cd8f3a3d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.565196 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-2913563c-eb17-4fde-a543-1451cd8f3a3d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c1118cae-23c9-4daf-9971-fe881434c74d HTTP/1.1" status: 204 len: 168 time: 0.1384807 Nov 16 03:22:15.574764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2913563c-eb17-4fde-a543-1451cd8f3a3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1118cae-23c9-4daf-9971-fe881434c74d,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:15.638682 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d31c4daf-2cc8-4a47-9710-52c3d8f62e71 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:22:15.692806 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:22:15.699938 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:22:15.700309 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.791208 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.818869 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:22:15.821191 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9b24799-06c4-46eb-b956-01662f177226" -d '{"events": [{"server_uuid": "e82b17c5-3261-437a-8359-cb08064fb2c1", "name": "network-vif-plugged", "status": "completed", "tag": "d31c4daf-2cc8-4a47-9710-52c3d8f62e71"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:22:15.840850 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:15.845372 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:15.870224 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:22:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4284a226-4f32-4611-a31d-d09f04fc6f7c x-openstack-request-id: req-4284a226-4f32-4611-a31d-d09f04fc6f7c {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:22:15.870541 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e82b17c5-3261-437a-8359-cb08064fb2c1", "name": "network-vif-plugged", "status": "completed", "tag": "d31c4daf-2cc8-4a47-9710-52c3d8f62e71", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:22:15.870829 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-4284a226-4f32-4611-a31d-d09f04fc6f7c {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:22:15.871362 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71', 'code': 200} Nov 16 03:22:15.898227 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:16.187414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55868fe6-c271-4826-8e5c-62466e5c63b1 req-570f31d1-cb71-4bfa-a7fb-64ec3d91d7e1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:16.188894 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-55868fe6-c271-4826-8e5c-62466e5c63b1 req-570f31d1-cb71-4bfa-a7fb-64ec3d91d7e1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0680194 Nov 16 03:22:16.195721 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd17222-a712-49bb-8e74-1848e12d2320 req-fb21a7ad-b8e9-4017-801a-4dc2d8b32487 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:16.197333 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-0fd17222-a712-49bb-8e74-1848e12d2320 req-fb21a7ad-b8e9-4017-801a-4dc2d8b32487 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 1099 time: 0.1552746 Nov 16 03:22:16.240386 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-55868fe6-c271-4826-8e5c-62466e5c63b1 req-f7a933d8-45cc-4fc1-9770-8568291d4a14 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441840 Nov 16 03:22:16.249807 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-0fd17222-a712-49bb-8e74-1848e12d2320 req-b10e4295-9fc2-427e-9a74-7cee34041a64 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437045 Nov 16 03:22:17.363685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27dd2d4-dff5-4d6d-86cc-7635308e17ed req-4179f897-87c5-4ffa-a08c-624b456ea21a tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:17.365206 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a27dd2d4-dff5-4d6d-86cc-7635308e17ed req-4179f897-87c5-4ffa-a08c-624b456ea21a tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0545444 Nov 16 03:22:17.417638 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a27dd2d4-dff5-4d6d-86cc-7635308e17ed req-804077c0-9bee-4709-acfa-0cdebca464be tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462408 Nov 16 03:22:18.444859 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-af5afe26-ed45-48b9-9181-0bc7a29ee2b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:18.544000 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a02ad2-1e69-444b-aa42-af40a0d46b4f req-708086e7-3fd8-4244-9bdd-12b60a81bfd1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:18.545485 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3a02ad2-1e69-444b-aa42-af40a0d46b4f req-708086e7-3fd8-4244-9bdd-12b60a81bfd1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0519204 Nov 16 03:22:18.594023 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3a02ad2-1e69-444b-aa42-af40a0d46b4f req-1510ea23-1430-478d-ac1b-2c53d96ae67d tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425532 Nov 16 03:22:19.767686 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:20.791202 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48218) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:20.902436 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-57ebf1f7-3331-4997-9d28-427c03331796 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:20.986166 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-57ebf1f7-3331-4997-9d28-427c03331796 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:20.992371 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-57ebf1f7-3331-4997-9d28-427c03331796 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.035641 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57ebf1f7-3331-4997-9d28-427c03331796 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47bf0326-ff00-4b29-bbf7-aa16e53bcbc8,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:21.042688 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-57ebf1f7-3331-4997-9d28-427c03331796 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=a028dbd331974ef78f34ceaae88ba348&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2500069 Nov 16 03:22:21.043917 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48224) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:21.094604 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e0c43db-1660-41ce-a2f0-efdce9f1be27 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.116736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e0c43db-1660-41ce-a2f0-efdce9f1be27 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.172183 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e0c43db-1660-41ce-a2f0-efdce9f1be27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.175820 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1e0c43db-1660-41ce-a2f0-efdce9f1be27 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.177496 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-1e0c43db-1660-41ce-a2f0-efdce9f1be27 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/47bf0326-ff00-4b29-bbf7-aa16e53bcbc8 HTTP/1.1" status: 204 len: 168 time: 0.1314914 Nov 16 03:22:21.185891 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e0c43db-1660-41ce-a2f0-efdce9f1be27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47bf0326-ff00-4b29-bbf7-aa16e53bcbc8,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:21.476465 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48232) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:21.490707 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf61aa32-031a-44c3-becc-d00291d6c5d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.499170 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.573333 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf61aa32-031a-44c3-becc-d00291d6c5d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.580004 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bf61aa32-031a-44c3-becc-d00291d6c5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.601527 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.618434 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-bf61aa32-031a-44c3-becc-d00291d6c5d2 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8c5574c25ce844588d047d8ff03ffce9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1408391 Nov 16 03:22:21.619438 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf61aa32-031a-44c3-becc-d00291d6c5d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=485285c2-01a1-4787-8c02-f81faf43f875,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:21.621167 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48234) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:21.668188 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-38286db7-27ee-4cac-9d58-52f3bc2f6869 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.689484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-38286db7-27ee-4cac-9d58-52f3bc2f6869 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.737155 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-38286db7-27ee-4cac-9d58-52f3bc2f6869 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.739958 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-38286db7-27ee-4cac-9d58-52f3bc2f6869 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:21.743853 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-38286db7-27ee-4cac-9d58-52f3bc2f6869 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/485285c2-01a1-4787-8c02-f81faf43f875 HTTP/1.1" status: 204 len: 168 time: 0.1215787 Nov 16 03:22:21.752739 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38286db7-27ee-4cac-9d58-52f3bc2f6869 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=485285c2-01a1-4787-8c02-f81faf43f875,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:23.778866 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793c1759-ddb3-4f38-ad57-fb531d97aa26 req-22cfe97b-2f95-460c-8056-502ad9360aae tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:23.780571 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-793c1759-ddb3-4f38-ad57-fb531d97aa26 req-22cfe97b-2f95-460c-8056-502ad9360aae tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0518024 Nov 16 03:22:23.823391 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-5140ca0f-9efc-426a-9d5d-87d3e6db2440 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:23.825737 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-5140ca0f-9efc-426a-9d5d-87d3e6db2440 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1138 time: 0.0551696 Nov 16 03:22:23.848707 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-793c1759-ddb3-4f38-ad57-fb531d97aa26 req-c02d3d2c-680d-422e-b5b1-ff465a03e37a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0615013 Nov 16 03:22:23.928580 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-df6d0cbf-7a46-4e27-b61d-d9b62ce6af50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:23.930106 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-df6d0cbf-7a46-4e27-b61d-d9b62ce6af50 service neutron] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 915 time: 0.0934415 Nov 16 03:22:24.041325 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-f3571225-4948-41f0-aa27-e88d265e06d8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 1002 time: 0.0929773 Nov 16 03:22:24.095365 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-01f7b5ad-3853-455e-96f2-ae5c25ebd02f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:24.096797 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-01f7b5ad-3853-455e-96f2-ae5c25ebd02f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.0466106 Nov 16 03:22:24.157698 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-c27e8436-f3dd-482b-b826-aeb7a3c2841e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:24.159605 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-c27e8436-f3dd-482b-b826-aeb7a3c2841e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461578 Nov 16 03:22:24.264507 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-b4d14df2-6cc7-4cde-8446-e6a20c69f7c0 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0955400 Nov 16 03:22:24.361754 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-b0ad58a9-744f-42f8-9add-26338c7ed74b req-cbb52ebd-48e4-40c1-a6ab-b65ed1835339 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888608 Nov 16 03:22:24.972558 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7666109e-925d-4677-bd84-c9d3aa18a707 req-6a325237-6be6-46a7-a8d5-7abf1788032f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:24.974084 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7666109e-925d-4677-bd84-c9d3aa18a707 req-6a325237-6be6-46a7-a8d5-7abf1788032f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0529473 Nov 16 03:22:25.036361 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7666109e-925d-4677-bd84-c9d3aa18a707 req-73b3ee57-31b5-423b-b737-5107fb7dc52a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0559766 Nov 16 03:22:26.154139 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c996d9b-4dfc-4d46-abf0-b7a2e346ede5 req-f007d594-98da-46df-8b7b-50941ad84659 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:26.155630 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c996d9b-4dfc-4d46-abf0-b7a2e346ede5 req-f007d594-98da-46df-8b7b-50941ad84659 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0510502 Nov 16 03:22:26.218114 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c996d9b-4dfc-4d46-abf0-b7a2e346ede5 req-0bf00163-61b7-4a44-a25a-0b4e73260cfd tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0553722 Nov 16 03:22:26.262039 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48332) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:26.373919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cfc6016b-afe5-4038-ae25-2776b12651e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.447010 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cfc6016b-afe5-4038-ae25-2776b12651e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.452147 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-cfc6016b-afe5-4038-ae25-2776b12651e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.504447 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-cfc6016b-afe5-4038-ae25-2776b12651e3 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=85935e79e2734a8ba3576ebebe80ac52&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2412920 Nov 16 03:22:26.505305 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc6016b-afe5-4038-ae25-2776b12651e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89e1c489-614f-4280-b259-e00f2c8eb9c2,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:26.507430 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48342) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:26.562582 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e01f8d92-7629-4194-8b43-01f2c5efc923 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.584711 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e01f8d92-7629-4194-8b43-01f2c5efc923 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.631019 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e01f8d92-7629-4194-8b43-01f2c5efc923 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.633682 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e01f8d92-7629-4194-8b43-01f2c5efc923 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.634845 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e01f8d92-7629-4194-8b43-01f2c5efc923 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/89e1c489-614f-4280-b259-e00f2c8eb9c2 HTTP/1.1" status: 204 len: 168 time: 0.1262815 Nov 16 03:22:26.642438 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e01f8d92-7629-4194-8b43-01f2c5efc923 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89e1c489-614f-4280-b259-e00f2c8eb9c2,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:26.906197 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48350) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:26.920674 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bc3ac1b2-af5f-4075-9f2b-3ceaad0f0304 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:26.997462 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bc3ac1b2-af5f-4075-9f2b-3ceaad0f0304 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:27.002872 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bc3ac1b2-af5f-4075-9f2b-3ceaad0f0304 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:27.040035 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-bc3ac1b2-af5f-4075-9f2b-3ceaad0f0304 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=6336ef1ac19545f4b3960972f0dfec34&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1327486 Nov 16 03:22:27.040898 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc3ac1b2-af5f-4075-9f2b-3ceaad0f0304 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=672f3a34-8d87-4881-947d-e534096ad9d7,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:27.043075 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48352) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:27.095469 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f6c9ce3d-d1da-4ef7-bada-02a1ac681234 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:27.118447 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f6c9ce3d-d1da-4ef7-bada-02a1ac681234 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:27.172696 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f6c9ce3d-d1da-4ef7-bada-02a1ac681234 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:27.176681 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f6c9ce3d-d1da-4ef7-bada-02a1ac681234 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:27.178358 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f6c9ce3d-d1da-4ef7-bada-02a1ac681234 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/672f3a34-8d87-4881-947d-e534096ad9d7 HTTP/1.1" status: 204 len: 168 time: 0.1342912 Nov 16 03:22:27.186525 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c9ce3d-d1da-4ef7-bada-02a1ac681234 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=672f3a34-8d87-4881-947d-e534096ad9d7,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:27.348292 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d986cdbc-40fe-4180-a6d5-37df703ed192 req-9926ca4b-800d-4d6c-aedb-d9d9818ecca2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:27.359142 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d986cdbc-40fe-4180-a6d5-37df703ed192 req-9926ca4b-800d-4d6c-aedb-d9d9818ecca2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0596967 Nov 16 03:22:27.412775 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d986cdbc-40fe-4180-a6d5-37df703ed192 req-6a4ff2af-26a1-4207-82fd-45088a9c72cb tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0562770 Nov 16 03:22:27.934194 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48378) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:28.037615 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-885292710-network', 'tenant_id': '860c6370cf9e4b0a9073def1b3e9c8d4'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:22:28.064061 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Made reservation on behalf of 860c6370cf9e4b0a9073def1b3e9c8d4 for: {'network': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:22:28.066710 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.075136 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.152522 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.158733 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.184120 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 340} {{(pid=101899) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:22:28.194571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=229c0e7a-08a8-467d-b101-fda9936d59ea,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:28.200810 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.201159 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.segments_db [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Added segment f581f976-9993-436c-adeb-76dad1297e85 of type vlan for network 96be1cd6-0c47-4d45-b096-e3e10f32453d Nov 16 03:22:28.243123 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.270690 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.271666 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:28.272246 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.331024 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3957682 Nov 16 03:22:28.334360 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48382) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:28.335983 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4abed8b8-1f2d-4141-805a-06475700dc14 admin admin] Pushing event updated for resources: {'Network': ['ID=96be1cd6-0c47-4d45-b096-e3e10f32453d,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:28.340243 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Request body: {'subnet': {'network_id': '96be1cd6-0c47-4d45-b096-e3e10f32453d', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-885292710-subnet', 'tenant_id': '860c6370cf9e4b0a9073def1b3e9c8d4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:22:28.347033 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 96be1cd6-0c47-4d45-b096-e3e10f32453d details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:22:28.364050 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Made reservation on behalf of 860c6370cf9e4b0a9073def1b3e9c8d4 for: {'subnet': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:22:28.366708 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-128616602'] for subnet, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.548219 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-128585965', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-128616584'] for subnet, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.605812 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c2bcbf7f-7980-49f0-b950-a9c84c2dd2df,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:28.623821 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Checking segment: {'id': 'f581f976-9993-436c-adeb-76dad1297e85', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '96be1cd6-0c47-4d45-b096-e3e10f32453d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:22:28.624411 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Network hostable DHCP agents. Network: 96be1cd6-0c47-4d45-b096-e3e10f32453d, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101898) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:22:28.645098 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Network 96be1cd6-0c47-4d45-b096-e3e10f32453d is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101898) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:22:28.656819 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 96be1cd6-0c47-4d45-b096-e3e10f32453d) {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:22:28.662609 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:28.663296 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:28.669447 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-118bd145-e28d-4f20-9b6c-abe5f512fb0d None None] Network 96be1cd6-0c47-4d45-b096-e3e10f32453d requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:22:28.687478 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b7016c9a-2845-4ae1-97e8-d78f5e7a63c8 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3517618 Nov 16 03:22:28.770155 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b142020f-0593-42f4-bca3-5ac0d45cf910 req-6da126c1-1f9b-4b1e-af84-7834b0860046 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:28.771852 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b142020f-0593-42f4-bca3-5ac0d45cf910 req-6da126c1-1f9b-4b1e-af84-7834b0860046 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.2875712 Nov 16 03:22:28.818643 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdebe93e-dcc1-4850-adf1-1633fbe22301 None None] Network 96be1cd6-0c47-4d45-b096-e3e10f32453d requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:22:28.840726 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b142020f-0593-42f4-bca3-5ac0d45cf910 req-a5e1b7c0-15e3-4a89-aa7b-0febc75823a1 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0622973 Nov 16 03:22:29.200943 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48402) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:29.207352 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-978786865-network', 'tenant_id': '3a88961c6f1b424db2d0e6211c7a405c'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:22:29.230531 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Made reservation on behalf of 3a88961c6f1b424db2d0e6211c7a405c for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:22:29.232685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.241076 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.319444 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.323931 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.348749 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 336} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:22:29.358356 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ae5c05c-7717-406c-8b27-4bde479132e8,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:29.363269 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.363601 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Added segment 86139c41-4931-41fe-a800-3b1737e698ba of type vlan for network 5c298080-4a30-4a23-a4d7-a0f95648a535 Nov 16 03:22:29.404472 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.431582 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.432664 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:29.433403 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.491534 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.2891371 Nov 16 03:22:29.494724 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48404) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:29.496388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a5a427-9b70-4453-93fa-ec314f743c61 admin admin] Pushing event updated for resources: {'Network': ['ID=5c298080-4a30-4a23-a4d7-a0f95648a535,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:29.499797 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Request body: {'subnet': {'network_id': '5c298080-4a30-4a23-a4d7-a0f95648a535', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-978786865-subnet', 'tenant_id': '3a88961c6f1b424db2d0e6211c7a405c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:22:29.509779 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 5c298080-4a30-4a23-a4d7-a0f95648a535 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:22:29.523809 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Made reservation on behalf of 3a88961c6f1b424db2d0e6211c7a405c for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:22:29.526414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.709151 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.770918 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Pushing event updated for resources: {'Subnet': ['ID=74ee6a83-743b-4033-85bd-6267cb09d54b,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:29.781240 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Checking segment: {'id': '86139c41-4931-41fe-a800-3b1737e698ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 336, 'network_id': '5c298080-4a30-4a23-a4d7-a0f95648a535'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:22:29.781625 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Network hostable DHCP agents. Network: 5c298080-4a30-4a23-a4d7-a0f95648a535, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:22:29.800447 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Network 5c298080-4a30-4a23-a4d7-a0f95648a535 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:22:29.810490 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 5c298080-4a30-4a23-a4d7-a0f95648a535) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:22:29.814880 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:29.815697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:29.821781 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcb570f0-9e6b-4941-aa04-845d8552f55c None None] Network 5c298080-4a30-4a23-a4d7-a0f95648a535 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:22:29.834291 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-e147147a-df6d-4147-b425-8b3dc1327547 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3383539 Nov 16 03:22:29.956504 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81b52269-f737-4ec7-b3ca-e655c45d44f9 None None] Network 5c298080-4a30-4a23-a4d7-a0f95648a535 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:22:29.973107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c7c3f2-727a-40ec-8f6b-cd8cb2f9320d req-8919613e-6ce1-4e46-9cf2-ef39e740f108 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:29.974667 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d7c7c3f2-727a-40ec-8f6b-cd8cb2f9320d req-8919613e-6ce1-4e46-9cf2-ef39e740f108 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0619183 Nov 16 03:22:30.043539 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d7c7c3f2-727a-40ec-8f6b-cd8cb2f9320d req-c19a9dfa-99bf-4afa-a435-b8e6d6dfcf62 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0625880 Nov 16 03:22:31.168357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8725566e-6f71-47f6-8bb7-ea53bae8daf0 req-532e063d-46cb-405d-9391-175ec52fa841 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:31.169824 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8725566e-6f71-47f6-8bb7-ea53bae8daf0 req-532e063d-46cb-405d-9391-175ec52fa841 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0521889 Nov 16 03:22:31.232790 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8725566e-6f71-47f6-8bb7-ea53bae8daf0 req-1f6576ca-6076-47d8-af29-e4c89ccb4224 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0563529 Nov 16 03:22:32.360809 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d07d0914-2491-48ba-b4a4-75c55b874176 req-5a6ecaaf-9ded-49d3-888d-d47ab561dfc8 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:32.362410 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07d0914-2491-48ba-b4a4-75c55b874176 req-5a6ecaaf-9ded-49d3-888d-d47ab561dfc8 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0546582 Nov 16 03:22:32.433100 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d07d0914-2491-48ba-b4a4-75c55b874176 req-026b001c-1099-4a0e-a805-c4294a12e349 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0620494 Nov 16 03:22:33.553040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a941436-ea25-42df-bfc2-8b9310ca7712 req-0d3db149-2285-4e6a-b6b4-c132e331a5df tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:33.554512 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5a941436-ea25-42df-bfc2-8b9310ca7712 req-0d3db149-2285-4e6a-b6b4-c132e331a5df tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0513146 Nov 16 03:22:33.621304 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5a941436-ea25-42df-bfc2-8b9310ca7712 req-745aee90-b66e-471d-a71e-d56280d7ee8a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0577791 Nov 16 03:22:34.758433 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85757f90-6eb8-4a60-a44b-35a061c3bc3f req-dfe1d748-391b-4dc9-bf2e-97db385301c8 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:34.759912 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-85757f90-6eb8-4a60-a44b-35a061c3bc3f req-dfe1d748-391b-4dc9-bf2e-97db385301c8 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0578542 Nov 16 03:22:34.820778 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-85757f90-6eb8-4a60-a44b-35a061c3bc3f req-45c67566-79b9-4b47-81f8-4e667d3e5924 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0546684 Nov 16 03:22:35.818877 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:35.948297 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62eb45ad-42de-476e-a95a-d549ecbb2f32 req-30ed2768-1ff2-4345-901b-f5207de3f0f9 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:35.949792 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-62eb45ad-42de-476e-a95a-d549ecbb2f32 req-30ed2768-1ff2-4345-901b-f5207de3f0f9 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0547445 Nov 16 03:22:36.010819 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-62eb45ad-42de-476e-a95a-d549ecbb2f32 req-49af498a-64a9-459b-939f-a419a30d300b tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0546861 Nov 16 03:22:36.136572 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:22:36.619553 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262dd680-e26b-4be6-a7ae-bc7df760576c req-8471b165-5b2c-4fa5-a81e-930ffdb3cd6b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:36.620953 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-262dd680-e26b-4be6-a7ae-bc7df760576c req-8471b165-5b2c-4fa5-a81e-930ffdb3cd6b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0527503 Nov 16 03:22:36.673103 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-262dd680-e26b-4be6-a7ae-bc7df760576c req-302256af-0737-4777-a866-58205e582970 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430119 Nov 16 03:22:37.143239 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-240532af-c1df-4ae8-b0cb-e4634ad90799 req-bc45e959-4e95-40bd-b696-7eb911490089 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:37.144874 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-240532af-c1df-4ae8-b0cb-e4634ad90799 req-bc45e959-4e95-40bd-b696-7eb911490089 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0515258 Nov 16 03:22:37.214584 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-240532af-c1df-4ae8-b0cb-e4634ad90799 req-363ed3e6-fb9a-44eb-93ee-0d6618fb7a89 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0633874 Nov 16 03:22:37.808817 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95798e3f-5879-48cd-95fe-08a889c5ab94 req-3c17b530-2f15-41e4-920f-b0e026dbdc51 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:37.810430 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-95798e3f-5879-48cd-95fe-08a889c5ab94 req-3c17b530-2f15-41e4-920f-b0e026dbdc51 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0525782 Nov 16 03:22:37.860745 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-95798e3f-5879-48cd-95fe-08a889c5ab94 req-5c7c4781-7c41-4457-9c3f-6dc9bbab9bbf tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433214 Nov 16 03:22:38.334732 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08ffdfb-bb1f-4b5d-aaa9-ace5dd642cab req-8af23e81-60dd-42e6-b1a8-5860d4636628 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:38.336189 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e08ffdfb-bb1f-4b5d-aaa9-ace5dd642cab req-8af23e81-60dd-42e6-b1a8-5860d4636628 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0526800 Nov 16 03:22:38.402906 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e08ffdfb-bb1f-4b5d-aaa9-ace5dd642cab req-ac9d6666-cfa9-41cb-88f6-ccaab9051ef6 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0600319 Nov 16 03:22:39.005901 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd03c08-d395-4d3c-af3a-926011bd78b3 req-ba445d18-85e5-494c-96d1-329603f40188 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:39.007632 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6fd03c08-d395-4d3c-af3a-926011bd78b3 req-ba445d18-85e5-494c-96d1-329603f40188 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0672691 Nov 16 03:22:39.060700 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6fd03c08-d395-4d3c-af3a-926011bd78b3 req-b254a960-8f37-4132-9c1b-7c3ade08e6a6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468976 Nov 16 03:22:39.533914 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde71c5f-c5cd-4be5-8c4e-da08d235b647 req-84f1a3b7-acfb-4dd7-8962-14f703d9bf0c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:39.536176 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fde71c5f-c5cd-4be5-8c4e-da08d235b647 req-84f1a3b7-acfb-4dd7-8962-14f703d9bf0c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0617852 Nov 16 03:22:39.608438 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fde71c5f-c5cd-4be5-8c4e-da08d235b647 req-d0739e18-150e-446a-9917-33a62365628c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0657067 Nov 16 03:22:39.758836 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb589fb0-75f9-46e7-afe3-ae662a025f8b req-3ebaf698-8a2e-4276-a2f5-f59cbf9db5ae tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:39.760401 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cb589fb0-75f9-46e7-afe3-ae662a025f8b req-3ebaf698-8a2e-4276-a2f5-f59cbf9db5ae tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0566566 Nov 16 03:22:39.813084 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cb589fb0-75f9-46e7-afe3-ae662a025f8b req-aea4dc68-ad5f-4c84-be62-8585a79af624 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466888 Nov 16 03:22:40.197915 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2e53910-deee-4214-8a02-13de79d615d4 req-7039fa04-a2f9-4ef7-adfd-ad62a915cd10 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:40.199560 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f2e53910-deee-4214-8a02-13de79d615d4 req-7039fa04-a2f9-4ef7-adfd-ad62a915cd10 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0574431 Nov 16 03:22:40.257288 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f2e53910-deee-4214-8a02-13de79d615d4 req-81ddd1e8-a32a-4cfb-8d73-3e7b0303ddd6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482380 Nov 16 03:22:40.738960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2cd8bc-691b-4e87-bb4b-5ab77352d965 req-d4b3d705-b00a-4922-b53d-0c8058089d41 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:40.741721 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1a2cd8bc-691b-4e87-bb4b-5ab77352d965 req-d4b3d705-b00a-4922-b53d-0c8058089d41 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.0626993 Nov 16 03:22:40.815611 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1a2cd8bc-691b-4e87-bb4b-5ab77352d965 req-257c5e05-7cb6-4cfe-82e8-946cdab7bd8f tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=779f874f-c312-438b-8e31-979b354c2f48&id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0675149 Nov 16 03:22:40.941487 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b36d58-3791-4f88-b96f-01d8702bf850 req-75369de2-3587-4f58-9f4c-71f4a61afd0b tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:40.942858 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-16b36d58-3791-4f88-b96f-01d8702bf850 req-75369de2-3587-4f58-9f4c-71f4a61afd0b tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0535500 Nov 16 03:22:40.994211 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-16b36d58-3791-4f88-b96f-01d8702bf850 req-3e6b50ec-2a85-4b28-abcc-919d33a6d8dd tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416172 Nov 16 03:22:41.388644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-372218b6-3e23-4b42-82e6-527ae0dc300a req-bd5fd48e-c307-4162-a461-051a383798be tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:41.390204 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-372218b6-3e23-4b42-82e6-527ae0dc300a req-bd5fd48e-c307-4162-a461-051a383798be tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0518827 Nov 16 03:22:41.438549 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-372218b6-3e23-4b42-82e6-527ae0dc300a req-cf02b9c9-c28d-4297-9266-c0487c457699 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423346 Nov 16 03:22:41.777142 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-5b703b42-4358-413f-a8cd-7549ec8f43c1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:41.778631 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-5b703b42-4358-413f-a8cd-7549ec8f43c1 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0594752 Nov 16 03:22:41.876645 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Deleting port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:22:41.876986 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:41.973079 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] For port d31c4daf-2cc8-4a47-9710-52c3d8f62e71, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,segment=NetworkSegment(a588d9a5-69c1-45a5-8a3e-1710c2c5fde9),segment_id=a588d9a5-69c1-45a5-8a3e-1710c2c5fde9)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:41.973403 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:41.985846 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Calling delete_port for d31c4daf-2cc8-4a47-9710-52c3d8f62e71 owned by compute:nova {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:22:42.120160 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:42.129177 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb0edd77-d905-4195-8417-8575c09166e5 req-321db0bb-8040-4f02-a7cb-3494d9a18daf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:42.130714 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb0edd77-d905-4195-8417-8575c09166e5 req-321db0bb-8040-4f02-a7cb-3494d9a18daf tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/ports?device_id=e82b17c5-3261-437a-8359-cb08064fb2c1 HTTP/1.1" status: 200 len: 946 time: 0.0533359 Nov 16 03:22:42.150942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Pushing event deleted for resources: {'Port': ['ID=d31c4daf-2cc8-4a47-9710-52c3d8f62e71,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:42.159662 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['d31c4daf-2cc8-4a47-9710-52c3d8f62e71'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:22:42.196576 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eb0edd77-d905-4195-8417-8575c09166e5 req-3041b02f-63a3-47e0-8251-5aa4441de310 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.31 "GET /v2.0/security-groups?id=1c649fc7-cfdb-48c7-841e-548f560a2e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574560 Nov 16 03:22:42.201848 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] No DVR routers for this DVR port d31c4daf-2cc8-4a47-9710-52c3d8f62e71 on host hv-cinder-81803 {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:22:42.205584 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:42.209227 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-8f04e82c-02c6-4f44-b1d1-5a19004e64eb req-3a61a4f3-d7a9-4d7c-97e5-74eb0effe350 tempest-VolumesSnapshotTestJSON-647266901 tempest-VolumesSnapshotTestJSON-647266901-project] 10.222.0.11 "DELETE /v2.0/ports/d31c4daf-2cc8-4a47-9710-52c3d8f62e71 HTTP/1.1" status: 204 len: 173 time: 0.4236107 Nov 16 03:22:42.209710 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'name': 'network-vif-deleted', 'tag': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:22:42.212608 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4efbb91-6960-44ae-835e-25c20ebda871" -d '{"events": [{"server_uuid": "e82b17c5-3261-437a-8359-cb08064fb2c1", "name": "network-vif-deleted", "tag": "d31c4daf-2cc8-4a47-9710-52c3d8f62e71"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:22:42.378366 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:22:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9958d2c-7aa3-4e73-aad3-3df8996daf22 x-openstack-request-id: req-a9958d2c-7aa3-4e73-aad3-3df8996daf22 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:22:42.378749 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e82b17c5-3261-437a-8359-cb08064fb2c1", "name": "network-vif-deleted", "tag": "d31c4daf-2cc8-4a47-9710-52c3d8f62e71", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:22:42.379083 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a9958d2c-7aa3-4e73-aad3-3df8996daf22 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:22:42.379697 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e82b17c5-3261-437a-8359-cb08064fb2c1', 'name': 'network-vif-deleted', 'tag': 'd31c4daf-2cc8-4a47-9710-52c3d8f62e71', 'status': 'completed', 'code': 200} Nov 16 03:22:42.571866 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659d4efc-2e7d-4dd1-8655-cfff82af5653 req-0e876ec5-ec6a-49ff-937d-965b8edf3adf tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:42.573854 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-659d4efc-2e7d-4dd1-8655-cfff82af5653 req-0e876ec5-ec6a-49ff-937d-965b8edf3adf tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0567229 Nov 16 03:22:42.628221 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-659d4efc-2e7d-4dd1-8655-cfff82af5653 req-b8a67653-32da-4fe8-8d1e-9bc4c181e91b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454390 Nov 16 03:22:43.759932 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7f6e4f-d594-4bac-b97e-60b188d20485 req-e63e0a14-2645-45ee-9f8a-3f523633f188 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:43.761394 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0a7f6e4f-d594-4bac-b97e-60b188d20485 req-e63e0a14-2645-45ee-9f8a-3f523633f188 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0569949 Nov 16 03:22:43.815650 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0a7f6e4f-d594-4bac-b97e-60b188d20485 req-e6e584dc-f1f8-4d25-8335-ff3bc4f23757 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481071 Nov 16 03:22:44.359069 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a643b940-4c01-46c5-b273-834a0d637e40 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:44.952239 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f0c1c3-927b-478e-863c-e0e05428abc7 req-1c7f100f-1a26-451b-8aa6-a1059e864496 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:44.953748 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-11f0c1c3-927b-478e-863c-e0e05428abc7 req-1c7f100f-1a26-451b-8aa6-a1059e864496 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0551462 Nov 16 03:22:45.015148 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-11f0c1c3-927b-478e-863c-e0e05428abc7 req-ef996151-bad0-4651-a6a4-02d0d264ba01 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513153 Nov 16 03:22:45.687110 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48664) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:45.735232 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Deleting subnet c2bcbf7f-7980-49f0-b950-a9c84c2dd2df {{(pid=101899) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:22:45.739429 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:45.779960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129335955'] for subnet, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:45.821140 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:45.875434 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126058139', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126233428'] for subnet, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:45.898861 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c2bcbf7f-7980-49f0-b950-a9c84c2dd2df,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:45.904846 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:45.908051 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-5ac0c05a-697f-45e0-be22-fbfc314639bc admin admin] 10.222.0.31 "DELETE /v2.0/subnets/c2bcbf7f-7980-49f0-b950-a9c84c2dd2df HTTP/1.1" status: 204 len: 168 time: 0.2196558 Nov 16 03:22:45.911033 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48668) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:45.985304 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.073267 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.095429 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96be1cd6-0c47-4d45-b096-e3e10f32453d']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:22:46.112479 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f581f976-9993-436c-adeb-76dad1297e85') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:22:46.112771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f581f976-9993-436c-adeb-76dad1297e85') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:22:46.141110 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.158695 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.167558 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Releasing vlan 340 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:22:46.168032 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:22:46.169782 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:22:46.187104 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80114f7-4f01-4971-a1d9-53650f2606f4 req-547df7a3-8768-44fd-9f32-8dc3d379648c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:46.188605 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e80114f7-4f01-4971-a1d9-53650f2606f4 req-547df7a3-8768-44fd-9f32-8dc3d379648c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0971599 Nov 16 03:22:46.254169 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.263847 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.267035 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] 10.222.0.31 "DELETE /v2.0/networks/96be1cd6-0c47-4d45-b096-e3e10f32453d HTTP/1.1" status: 204 len: 168 time: 0.3551009 Nov 16 03:22:46.270241 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48672) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:46.284968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a99529d4-e643-4bed-87c5-aee06b4369b9 admin admin] Pushing event deleted for resources: {'Network': ['ID=96be1cd6-0c47-4d45-b096-e3e10f32453d,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:46.290749 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e80114f7-4f01-4971-a1d9-53650f2606f4 req-662683d9-695e-40ac-82bc-cc7e4726ce5c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0768828 Nov 16 03:22:46.324787 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Deleting subnet 74ee6a83-743b-4033-85bd-6267cb09d54b {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:22:46.328442 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.364222 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.403191 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.461360 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.486998 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=74ee6a83-743b-4033-85bd-6267cb09d54b,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:46.490587 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.494213 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7e546153-5638-4db4-a62e-3e94c4a84bdf admin admin] 10.222.0.31 "DELETE /v2.0/subnets/74ee6a83-743b-4033-85bd-6267cb09d54b HTTP/1.1" status: 204 len: 168 time: 0.2228723 Nov 16 03:22:46.496799 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48674) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:46.569831 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.658685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.683285 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c298080-4a30-4a23-a4d7-a0f95648a535']}} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:22:46.693094 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '86139c41-4931-41fe-a800-3b1737e698ba') {'for_net_delete': True} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:22:46.693388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '86139c41-4931-41fe-a800-3b1737e698ba') {} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:22:46.702730 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129419530'] for segment, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.715650 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.721768 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Releasing vlan 336 on physical network physnet1 to pool {{(pid=101898) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:22:46.722142 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-128585750'] for segment, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.722398 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d31c4daf-2cc8-4a47-9710-52c3d8f62e71 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: Traceback (most recent call last): Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: timer() Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: cb(*args, **kw) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: return func(*args, **kwargs) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: self._notify() Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: self.callback(batched_events) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: event.method(event) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: return f(self, *a, **k) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._get(url).json() Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: return self.request(url, 'GET', **kwargs) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:22:46.723792 dv-cinder-818037-1-iscsi neutron-server[101898]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:22:46.745798 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: d31c4daf-2cc8-4a47-9710-52c3d8f62e71 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:22:46.746136 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device d31c4daf-2cc8-4a47-9710-52c3d8f62e71 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:22:46.778605 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.786322 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:46.792330 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] 10.222.0.31 "DELETE /v2.0/networks/5c298080-4a30-4a23-a4d7-a0f95648a535 HTTP/1.1" status: 204 len: 168 time: 0.2942917 Nov 16 03:22:46.802152 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8874de63-e265-4e92-ab77-622127e6ffe9 admin admin] Pushing event deleted for resources: {'Network': ['ID=5c298080-4a30-4a23-a4d7-a0f95648a535,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:46.960863 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48680) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:47.005938 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-75a5f885-d53d-45c6-a6a8-32fc4eda6c6d admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=860c6370cf9e4b0a9073def1b3e9c8d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0437160 Nov 16 03:22:47.009748 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 48682) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:47.057494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-99b315a7-e10a-4dfa-b1e0-cacb48fb44c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.079094 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-99b315a7-e10a-4dfa-b1e0-cacb48fb44c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.131364 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-99b315a7-e10a-4dfa-b1e0-cacb48fb44c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.134352 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-99b315a7-e10a-4dfa-b1e0-cacb48fb44c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.135503 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-99b315a7-e10a-4dfa-b1e0-cacb48fb44c1 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/229c0e7a-08a8-467d-b101-fda9936d59ea HTTP/1.1" status: 204 len: 168 time: 0.1249013 Nov 16 03:22:47.143691 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b315a7-e10a-4dfa-b1e0-cacb48fb44c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=229c0e7a-08a8-467d-b101-fda9936d59ea,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:47.418949 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1843c535-fdff-47a9-b549-3f0b086db64c req-3dc1432a-3df0-4a12-ae89-386d08e5f6a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:47.420799 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1843c535-fdff-47a9-b549-3f0b086db64c req-3dc1432a-3df0-4a12-ae89-386d08e5f6a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0528033 Nov 16 03:22:47.471473 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1843c535-fdff-47a9-b549-3f0b086db64c req-2ade3609-2c64-4ed3-8ae2-da08a52f61ba tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438805 Nov 16 03:22:47.482719 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48690) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:47.524071 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-56c33931-49b0-40d6-b768-2bd7cf3ce216 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=3a88961c6f1b424db2d0e6211c7a405c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0400872 Nov 16 03:22:47.526765 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 48692) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:22:47.586273 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f7545772-1d9d-41f2-bde3-3ba9921f22f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.621377 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f7545772-1d9d-41f2-bde3-3ba9921f22f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.674527 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f7545772-1d9d-41f2-bde3-3ba9921f22f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.677215 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f7545772-1d9d-41f2-bde3-3ba9921f22f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:47.678391 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f7545772-1d9d-41f2-bde3-3ba9921f22f8 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/6ae5c05c-7717-406c-8b27-4bde479132e8 HTTP/1.1" status: 204 len: 168 time: 0.1505103 Nov 16 03:22:47.687271 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7545772-1d9d-41f2-bde3-3ba9921f22f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ae5c05c-7717-406c-8b27-4bde479132e8,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:48.439267 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1651fe6d-0f09-4202-b597-9e19a9b62b4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:48.609378 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b5cc9b-540a-4cf8-8dcd-532917dff0b3 req-02f916f0-832f-4264-83ac-0abb7054cd15 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:48.611040 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-64b5cc9b-540a-4cf8-8dcd-532917dff0b3 req-02f916f0-832f-4264-83ac-0abb7054cd15 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0669205 Nov 16 03:22:48.660839 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-64b5cc9b-540a-4cf8-8dcd-532917dff0b3 req-41782303-8a9e-49eb-b3c1-6899080a458f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431986 Nov 16 03:22:49.772275 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:49.793786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d353440c-9679-4ce4-bcf4-977c18dba580 req-e73007be-7f85-4f7a-b691-241484e9250a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:49.796469 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d353440c-9679-4ce4-bcf4-977c18dba580 req-e73007be-7f85-4f7a-b691-241484e9250a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0585349 Nov 16 03:22:49.858630 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d353440c-9679-4ce4-bcf4-977c18dba580 req-162b3ecc-1148-4ac9-96ff-37fddf62de97 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470772 Nov 16 03:22:50.998386 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0f3550e-9150-4108-9d6c-43993941a5db req-d4aec2ef-4bdc-4642-b493-8c12c77dab6c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:51.000011 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0f3550e-9150-4108-9d6c-43993941a5db req-d4aec2ef-4bdc-4642-b493-8c12c77dab6c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0586782 Nov 16 03:22:51.059244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0f3550e-9150-4108-9d6c-43993941a5db req-7111e043-e9e5-413f-80f5-e31115f5defe tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520761 Nov 16 03:22:51.501679 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:51.598090 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:52.192735 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a773e9-dca4-4beb-a76f-be0e6b9a8de5 req-b37f29a9-1a04-4a47-9ecc-3aaaa7a59815 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:52.194419 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-40a773e9-dca4-4beb-a76f-be0e6b9a8de5 req-b37f29a9-1a04-4a47-9ecc-3aaaa7a59815 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0551889 Nov 16 03:22:52.245242 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-40a773e9-dca4-4beb-a76f-be0e6b9a8de5 req-b096e331-96e2-4424-b55e-6c0903993785 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446424 Nov 16 03:22:53.381347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842dbc25-010e-48fe-9a9f-0afb91db276f req-c4794093-1dce-4521-bd9d-49f2e03f9f6b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:53.382906 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-842dbc25-010e-48fe-9a9f-0afb91db276f req-c4794093-1dce-4521-bd9d-49f2e03f9f6b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0618708 Nov 16 03:22:53.438137 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-842dbc25-010e-48fe-9a9f-0afb91db276f req-14d704f3-61c9-422d-9d7f-5e1321aa132f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442560 Nov 16 03:22:54.568241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ece5b2c4-7007-4834-a695-df8b1f7aa047 req-5dbe29d7-8b82-403d-9203-c3dfc279e47b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:54.569922 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ece5b2c4-7007-4834-a695-df8b1f7aa047 req-5dbe29d7-8b82-403d-9203-c3dfc279e47b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0558243 Nov 16 03:22:54.621670 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ece5b2c4-7007-4834-a695-df8b1f7aa047 req-44d20f59-ccf3-4878-9437-bf70d0558e3b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439613 Nov 16 03:22:55.754195 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1421fc9-d4a1-43ab-a9bb-de3901cfc6f8 req-b3629e28-44d0-44b8-ad04-73a72886c1ff tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:55.755733 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e1421fc9-d4a1-43ab-a9bb-de3901cfc6f8 req-b3629e28-44d0-44b8-ad04-73a72886c1ff tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0529997 Nov 16 03:22:55.808819 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e1421fc9-d4a1-43ab-a9bb-de3901cfc6f8 req-16375e61-9399-4e43-a199-66bd1049708b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471146 Nov 16 03:22:56.385031 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:22:56.490958 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:56.508364 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'mac_address': 'fa:16:3e:c6:a7:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:22:56.550867 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:56.564780 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c8dba4d7-4e08-40c8-a119-0e68144a64b1 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:22:56.590277 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:56.597154 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:56.648886 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=6']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:56.799592 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['c8dba4d7-4e08-40c8-a119-0e68144a64b1'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:22:56.941484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7986e9-36bf-4bb1-8b4b-756fcd151324 req-03827006-02b6-436c-9410-22f46e2977cb tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:56.942921 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7f7986e9-36bf-4bb1-8b4b-756fcd151324 req-03827006-02b6-436c-9410-22f46e2977cb tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0575278 Nov 16 03:22:56.997894 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7f7986e9-36bf-4bb1-8b4b-756fcd151324 req-1fd36871-fea0-4e8f-aebe-72a8344635e9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487127 Nov 16 03:22:58.133181 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d46b2e9-19c9-45db-b69b-01261eac431f req-a569fb02-e2e0-43e1-a76d-6a9abceb0850 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:58.134902 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3d46b2e9-19c9-45db-b69b-01261eac431f req-a569fb02-e2e0-43e1-a76d-6a9abceb0850 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0556047 Nov 16 03:22:58.184172 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3d46b2e9-19c9-45db-b69b-01261eac431f req-9b7a1b75-6ba0-4d53-8728-272fd8a4b761 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429089 Nov 16 03:22:58.391159 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:22:58.448413 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port c8dba4d7-4e08-40c8-a119-0e68144a64b1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:22:58.448779 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:58.540611 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:58.564707 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:22:58.568914 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6269a1b7-dc24-435f-92b8-bb3166517f4f" -d '{"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-plugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:22:58.594082 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:22:58.599786 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:22:58.657591 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=7']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:22:58.737873 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:22:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca84a0bb-ff5a-4a64-9354-7b84a5c18804 x-openstack-request-id: req-ca84a0bb-ff5a-4a64-9354-7b84a5c18804 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:22:58.738175 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-plugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:22:58.738427 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-ca84a0bb-ff5a-4a64-9354-7b84a5c18804 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:22:58.738858 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'code': 200} Nov 16 03:22:59.352786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e2499b6-52a4-452a-a4bb-42a84885321a req-f80d31ff-57cc-4e10-94db-09127b99c638 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:22:59.355294 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3e2499b6-52a4-452a-a4bb-42a84885321a req-f80d31ff-57cc-4e10-94db-09127b99c638 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0720582 Nov 16 03:22:59.438144 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3e2499b6-52a4-452a-a4bb-42a84885321a req-8f2e7cdb-a5a9-485b-b470-edaca76b79f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0729940 Nov 16 03:23:00.579960 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e39462-d633-4049-bba2-434a502541a9 req-aa270288-2b3c-49fe-8016-d7f677da910e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:00.581525 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-22e39462-d633-4049-bba2-434a502541a9 req-aa270288-2b3c-49fe-8016-d7f677da910e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0576324 Nov 16 03:23:00.643030 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-22e39462-d633-4049-bba2-434a502541a9 req-c53e606a-2ccd-41c5-a354-5d9820070497 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551331 Nov 16 03:23:01.790527 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a77025c-a2a7-440a-b3f2-472a9d6fc05b req-3c18f404-9da4-401e-bc7f-ef788af7cdd0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:01.793589 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a77025c-a2a7-440a-b3f2-472a9d6fc05b req-3c18f404-9da4-401e-bc7f-ef788af7cdd0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0598326 Nov 16 03:23:01.852412 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a77025c-a2a7-440a-b3f2-472a9d6fc05b req-3cbbc90e-14c8-4db2-bf1c-085f83f839bd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509398 Nov 16 03:23:03.008363 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d4c7884-651a-4f2a-92b0-47bff6b9885b req-ee3683dd-ec16-48c7-b229-7e8beb42cba3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:03.009962 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d4c7884-651a-4f2a-92b0-47bff6b9885b req-ee3683dd-ec16-48c7-b229-7e8beb42cba3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0690336 Nov 16 03:23:03.061562 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d4c7884-651a-4f2a-92b0-47bff6b9885b req-9ca9d23b-6a65-4b7d-9969-8439c9c23f31 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452554 Nov 16 03:23:04.022413 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-17b248cc-ddc7-4ada-8a13-967552703836 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0460815 Nov 16 03:23:04.152108 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-5ef621eb-702a-4b92-8207-7c748096212a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:04.153716 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-5ef621eb-702a-4b92-8207-7c748096212a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 1098 time: 0.0555162 Nov 16 03:23:04.206308 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b7bfd6-3469-4241-95ff-2b7ea30441ba req-0006d2a0-c67e-4b3f-aee0-934efa836dfa tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:04.214118 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b6b7bfd6-3469-4241-95ff-2b7ea30441ba req-0006d2a0-c67e-4b3f-aee0-934efa836dfa tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0616474 Nov 16 03:23:04.293987 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b6b7bfd6-3469-4241-95ff-2b7ea30441ba req-f5c5ae4e-7d17-4da8-ada5-381d1ecfe83d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0787630 Nov 16 03:23:04.330315 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-80d0a65d-21ad-4c30-a3f1-b70fc5ca3865 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:04.332271 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-80d0a65d-21ad-4c30-a3f1-b70fc5ca3865 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.1365762 Nov 16 03:23:04.424415 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-cf89a57a-4169-4fc6-ab85-708cad781690 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1 HTTP/1.1" status: 200 len: 1001 time: 0.0834153 Nov 16 03:23:04.499785 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-d62d68ad-69ee-4cb0-b1aa-24af5deaab9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:04.501954 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-d62d68ad-69ee-4cb0-b1aa-24af5deaab9e service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0682232 Nov 16 03:23:04.596652 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-7471cc94-2e68-4e2b-b540-2e0ac5ec5743 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:04.608338 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-7471cc94-2e68-4e2b-b540-2e0ac5ec5743 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0887513 Nov 16 03:23:04.725487 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-52997631-3844-400b-9027-99c91c18e22c service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1174662 Nov 16 03:23:04.851470 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-15c79851-0055-4352-b8ef-97380f37a1a9 req-6f75e6a5-a00e-40de-8190-2a4a83943230 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1175029 Nov 16 03:23:05.444670 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23737f64-5670-4b66-b368-797a6b6f40ae req-c1f0511f-b713-45b6-bc22-3cfdbaa2d1da tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:05.454136 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23737f64-5670-4b66-b368-797a6b6f40ae req-c1f0511f-b713-45b6-bc22-3cfdbaa2d1da tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0622184 Nov 16 03:23:05.518993 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23737f64-5670-4b66-b368-797a6b6f40ae req-ff6b41b1-5ad1-42c1-b15b-5e195e102711 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630751 Nov 16 03:23:05.859582 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:06.706459 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf875e5-4c18-4fd8-b66d-6a85fe207387 req-a49806ef-9b43-4427-ab79-5ada064bdb95 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:06.709825 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9cf875e5-4c18-4fd8-b66d-6a85fe207387 req-a49806ef-9b43-4427-ab79-5ada064bdb95 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0775554 Nov 16 03:23:06.772168 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9cf875e5-4c18-4fd8-b66d-6a85fe207387 req-c8c90602-6db0-448d-9610-00a768f3ec13 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523126 Nov 16 03:23:06.881167 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49000) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:06.935261 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Deleting subnet eb17dc2c-fa73-481e-b845-85a7c8e8df27 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:23:06.939076 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:06.985249 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.335278 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.405878 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.435480 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eb17dc2c-fa73-481e-b845-85a7c8e8df27,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:07.443794 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.444706 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/eb17dc2c-fa73-481e-b845-85a7c8e8df27 HTTP/1.1" status: 204 len: 168 time: 0.5623350 Nov 16 03:23:07.448302 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49004) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:07.451157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.451716 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.452269 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.452677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.453075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.453502 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.453903 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.454312 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.454713 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.455171 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.455496 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.455880 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d17396e9-c190-4b32-b11c-08ae9718e6b4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:07.576284 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.676611 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.710260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b79535bc-1164-4d3a-bbe9-6176a19d036c']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:07.725792 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:07.726662 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a588d9a5-69c1-45a5-8a3e-1710c2c5fde9') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:07.739424 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.759050 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.767179 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Releasing vlan 321 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:23:07.769118 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:23:07.769699 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:23:07.854409 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.878204 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:07.883814 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] 10.222.0.31 "DELETE /v2.0/networks/b79535bc-1164-4d3a-bbe9-6176a19d036c HTTP/1.1" status: 204 len: 168 time: 0.4320288 Nov 16 03:23:07.883814 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79c7022-8b12-4554-be88-cc20a052adc5 admin admin] Pushing event deleted for resources: {'Network': ['ID=b79535bc-1164-4d3a-bbe9-6176a19d036c,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:07.962895 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91014a8f-90bf-4bb2-9853-3fc7f8202b96 req-9d1d37ef-aaf4-4846-889f-a139a53a726f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:07.964540 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-91014a8f-90bf-4bb2-9853-3fc7f8202b96 req-9d1d37ef-aaf4-4846-889f-a139a53a726f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0796847 Nov 16 03:23:08.040585 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-91014a8f-90bf-4bb2-9853-3fc7f8202b96 req-4a561384-7068-4e39-962c-5bf73f980db2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0688455 Nov 16 03:23:08.164337 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49016) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:08.219040 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-6bd9dfaf-55f6-4bd2-b0da-fe2ce0655623 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ec26dd4c49f74ef7b1b41c9d379e7aa6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0548041 Nov 16 03:23:08.221850 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49018) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:08.276563 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-abebd7bf-6e4a-47d8-b009-3f189ebd380a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:08.302565 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-abebd7bf-6e4a-47d8-b009-3f189ebd380a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:08.382682 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-abebd7bf-6e4a-47d8-b009-3f189ebd380a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:08.385924 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-abebd7bf-6e4a-47d8-b009-3f189ebd380a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:08.387273 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-abebd7bf-6e4a-47d8-b009-3f189ebd380a admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/1c649fc7-cfdb-48c7-841e-548f560a2e77 HTTP/1.1" status: 204 len: 168 time: 0.1643834 Nov 16 03:23:08.406021 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abebd7bf-6e4a-47d8-b009-3f189ebd380a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c649fc7-cfdb-48c7-841e-548f560a2e77,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:09.230065 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9536dd4-c49d-4bab-95cd-6af8d91ed19f req-8950507a-a3f9-40c5-b6eb-9b852e9a2dc2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:09.234514 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b9536dd4-c49d-4bab-95cd-6af8d91ed19f req-8950507a-a3f9-40c5-b6eb-9b852e9a2dc2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.0866642 Nov 16 03:23:09.303534 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49058) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:09.316710 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b9536dd4-c49d-4bab-95cd-6af8d91ed19f req-5efb147a-ee2c-46bc-b7ab-d4ecd9d7e6fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0654576 Nov 16 03:23:09.437463 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-7c1b6217-b36e-4e4a-a406-788ed338b7ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:09.439021 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-7c1b6217-b36e-4e4a-a406-788ed338b7ee service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1099 time: 0.0462027 Nov 16 03:23:09.462021 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-701962731-network', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:09.532063 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Made reservation on behalf of 2ea0808579e44cdcaeba4109bc12863b for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:23:09.535053 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.552462 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.579956 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-26eb60a1-1356-46c6-b533-e3356e278061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:09.581454 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-26eb60a1-1356-46c6-b533-e3356e278061 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.1328843 Nov 16 03:23:09.673867 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-2620a4a9-96e0-4fdb-a5cd-ce2fb345d659 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 1002 time: 0.0808187 Nov 16 03:23:09.732615 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.739073 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.769010 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-cac459eb-ccc1-48bd-9f57-b43dc45aa2ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:09.770558 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-cac459eb-ccc1-48bd-9f57-b43dc45aa2ee service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0862663 Nov 16 03:23:09.771280 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 349} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:23:09.811563 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c266285f-90a6-468c-b1ea-cbfafbfc6d2d,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:09.814749 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.815069 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Added segment 13b9e88b-efa5-4d1d-81ea-971df0ce2a81 of type vlan for network 55d54831-cf2b-4880-8018-9fcb1b176026 Nov 16 03:23:09.864083 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.873907 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-aced01bb-f9ee-4470-b0df-528867777247 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:09.875482 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-aced01bb-f9ee-4470-b0df-528867777247 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0948958 Nov 16 03:23:09.941931 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:09.942913 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:09.943490 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.017773 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7116518 Nov 16 03:23:10.021287 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49064) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:10.023022 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57876d9-9a3f-4f09-bffa-4292640b090b admin admin] Pushing event updated for resources: {'Network': ['ID=55d54831-cf2b-4880-8018-9fcb1b176026,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:10.027805 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Request body: {'subnet': {'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-701962731-subnet', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:10.036804 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 55d54831-cf2b-4880-8018-9fcb1b176026 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:23:10.059318 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-b3502ffa-38f1-4b0f-9187-c9a1aa35cf89 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1713305 Nov 16 03:23:10.060289 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Made reservation on behalf of 2ea0808579e44cdcaeba4109bc12863b for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:23:10.062937 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.172211 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-20e72ce3-4422-4b51-bc92-44e8f40c9b4c req-eccba468-5506-4051-97fd-5e88550e3ed7 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1060648 Nov 16 03:23:10.297456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.356458 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Pushing event updated for resources: {'Subnet': ['ID=23f46016-2284-401d-92a1-617f967a864f,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:10.366482 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Checking segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:10.366840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Network hostable DHCP agents. Network: 55d54831-cf2b-4880-8018-9fcb1b176026, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:23:10.388518 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Network 55d54831-cf2b-4880-8018-9fcb1b176026 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:23:10.399701 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 55d54831-cf2b-4880-8018-9fcb1b176026) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:10.404839 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:10.405722 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.411810 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3fa2601-58c4-4107-97b4-8608f9371444 None None] Network 55d54831-cf2b-4880-8018-9fcb1b176026 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:23:10.432292 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-fdf149d7-783c-4a7e-9b7f-de287f3b0f8a admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4091370 Nov 16 03:23:10.435898 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49068) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:10.444553 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:10.506296 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.507690 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.534998 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91cf4395-f191-4e62-81d4-d8feb7e1432c req-287fead2-0c87-49ba-b126-9d33a7b7e6c7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:10.537965 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-91cf4395-f191-4e62-81d4-d8feb7e1432c req-287fead2-0c87-49ba-b126-9d33a7b7e6c7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.1025257 Nov 16 03:23:10.598381 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.632973 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-55d54831-cf2b-4880-8018-9fcb1b176026', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:23:10.634114 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.697691 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-91cf4395-f191-4e62-81d4-d8feb7e1432c req-6eda0467-e895-464d-b8b4-54b669c757cd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1468985 Nov 16 03:23:10.785482 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:10.817233 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Allocated IP 172.20.0.2 (55d54831-cf2b-4880-8018-9fcb1b176026/23f46016-2284-401d-92a1-617f967a864f/d3a5a2fa-7f90-4061-a114-c658b9a021d9) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:11.009071 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.020192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.059130 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.065513 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Network 55d54831-cf2b-4880-8018-9fcb1b176026 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:11.073092 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:11.076064 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:11.086385 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Pushing event updated for resources: {'Port': ['ID=d3a5a2fa-7f90-4061-a114-c658b9a021d9,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:11.097089 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.145161 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Attempting to bind port d3a5a2fa-7f90-4061-a114-c658b9a021d9 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:11.145462 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Attempting to bind port d3a5a2fa-7f90-4061-a114-c658b9a021d9 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:11.145847 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Attempting to bind port d3a5a2fa-7f90-4061-a114-c658b9a021d9 on network 55d54831-cf2b-4880-8018-9fcb1b176026 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:11.151823 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 22, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:11.152200 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Checking segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:11.152610 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.153007 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Bound using segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:11.153531 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Bound port: d3a5a2fa-7f90-4061-a114-c658b9a021d9, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:11.154030 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.231998 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] For port d3a5a2fa-7f90-4061-a114-c658b9a021d9, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:11.236761 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] For port d3a5a2fa-7f90-4061-a114-c658b9a021d9, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=d3a5a2fa-7f90-4061-a114-c658b9a021d9,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:11.243694 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.349647 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df52bd88-ca40-4c63-8262-4dc83aab19bb None None] Pushing event updated for resources: {'Port': ['ID=d3a5a2fa-7f90-4061-a114-c658b9a021d9,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:11.489920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Allocated IP 172.27.1.152 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/e40ae40d-0189-4a96-9fa9-5ea4b8ad8490) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:11.652851 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.697988 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:11.743390 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:11.746456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:11.750424 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:11.774465 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Pushing event updated for resources: {'Port': ['ID=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:11.932709 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa15d78-b6cc-4435-bfbb-b9f7df47e5ac req-a2447617-780a-4681-aee7-5c338750aeca tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:11.935233 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-caa15d78-b6cc-4435-bfbb-b9f7df47e5ac req-a2447617-780a-4681-aee7-5c338750aeca tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 946 time: 0.1377478 Nov 16 03:23:12.064322 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-caa15d78-b6cc-4435-bfbb-b9f7df47e5ac req-812b968c-840c-4286-b659-a23ea96a9379 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1177938 Nov 16 03:23:12.104733 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:12.341293 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:12.416677 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:12.449039 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4aff3210-2990-4800-9a23-8a22b0780b2d None None] Network 55d54831-cf2b-4880-8018-9fcb1b176026 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:23:12.500738 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Router 95164b65-5103-4ebd-944c-7883a34b1f32 is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101899) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:23:12.675349 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-0cfea510-f89c-49ee-9585-cf155d80ddf1 None None] Provisioning complete for port d3a5a2fa-7f90-4061-a114-c658b9a021d9 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:12.675636 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0cfea510-f89c-49ee-9585-cf155d80ddf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:12.678563 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:12.707498 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:12.709491 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-593702d2-3451-4789-823f-d1fe58de9349 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.2710464 Nov 16 03:23:12.712650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49090) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:12.724212 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Sync routers for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:12.811423 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:12.812087 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:22:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:12.882572 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:12.967540 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:12.969802 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93f39c3d-8064-428e-af03-02848f7cc5de" -d '{"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-unplugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:13.031311 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:13.038194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76a76ae0-2587-4f10-a746-7f2988c3edce x-openstack-request-id: req-76a76ae0-2587-4f10-a746-7f2988c3edce {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:13.038487 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-unplugged", "status": "failed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "code": 422}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:13.038766 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-76a76ae0-2587-4f10-a746-7f2988c3edce {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:13.039150 dv-cinder-818037-1-iscsi neutron-server[101900]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'code': 422} returned with failed status Nov 16 03:23:13.054057 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.088853 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0cfea510-f89c-49ee-9585-cf155d80ddf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.092194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:13.136634 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:23:13.223933 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=8']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:13.268425 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9bfdfbe-6b5d-48f5-ac25-1603fcf3cc89 req-c72bcc2d-ae46-4668-abe2-e59bd8ebe7f9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:13.270144 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f9bfdfbe-6b5d-48f5-ac25-1603fcf3cc89 req-c72bcc2d-ae46-4668-abe2-e59bd8ebe7f9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0911677 Nov 16 03:23:13.284676 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-0cfea510-f89c-49ee-9585-cf155d80ddf1 None None] For port d3a5a2fa-7f90-4061-a114-c658b9a021d9, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=d3a5a2fa-7f90-4061-a114-c658b9a021d9,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:13.303272 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0cfea510-f89c-49ee-9585-cf155d80ddf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.391404 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.414522 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device d3a5a2fa-7f90-4061-a114-c658b9a021d9 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:13.431209 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f9bfdfbe-6b5d-48f5-ac25-1603fcf3cc89 req-c2ff0be3-e649-46b3-9e20-9927042b075b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1216972 Nov 16 03:23:13.443205 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cfea510-f89c-49ee-9585-cf155d80ddf1 None None] Pushing event updated for resources: {'Port': ['ID=d3a5a2fa-7f90-4061-a114-c658b9a021d9,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:13.546823 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port d3a5a2fa-7f90-4061-a114-c658b9a021d9 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:13.547193 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.551688 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:11Z', 'revision_number': 3, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:13.596272 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-9790d452-840f-4695-ba01-d8267dadce6e None None] Provisioning complete for port d3a5a2fa-7f90-4061-a114-c658b9a021d9 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:13.596670 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-9790d452-840f-4695-ba01-d8267dadce6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.616558 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Checking router: 95164b65-5103-4ebd-944c-7883a34b1f32 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:13.616901 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Updating router 95164b65-5103-4ebd-944c-7883a34b1f32 port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:23:13.659447 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Allocated IP 172.20.0.1 (55d54831-cf2b-4880-8018-9fcb1b176026/23f46016-2284-401d-92a1-617f967a864f/978b43ed-a3a9-4d7a-a84a-b769fec14fc7) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:13.678145 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.833811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.874886 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:13.934165 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Network 55d54831-cf2b-4880-8018-9fcb1b176026 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:13.940098 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:13.944691 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:13.981931 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Pushing event updated for resources: {'Port': ['ID=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:14.006023 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.152682 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.162551 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.225198 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Attempting to bind port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:14.225518 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Attempting to bind port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:14.225881 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Attempting to bind port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:14.237279 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 22, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:14.237984 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:14.238409 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.238910 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:14.239477 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Bound port: e40ae40d-0189-4a96-9fa9-5ea4b8ad8490, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:14.239918 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.240096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.286529 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Pushing event updated for resources: {'Port': ['ID=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:14.289715 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-8ea87a9d-2a32-4b85-991b-850755f541de req-817f9c6c-383c-40a8-922d-eb012da0c0df service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:23:14.290994 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8ea87a9d-2a32-4b85-991b-850755f541de req-817f9c6c-383c-40a8-922d-eb012da0c0df service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1154273 Nov 16 03:23:14.314108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.314471 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.314811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.315137 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.315703 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.316010 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.316407 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.316942 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.317138 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.317337 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.317812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.318232 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:14.330397 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-17368037-9396-46bd-b08e-4dcccb2165b8 None None] Provisioning complete for port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:14.330652 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-17368037-9396-46bd-b08e-4dcccb2165b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.334526 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] For port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:14.389212 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] For port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:14.403103 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-9c85b2bf-b5a3-45b7-b524-158eaeeb4c9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.406301 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.439642 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-17368037-9396-46bd-b08e-4dcccb2165b8 None None] Port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:23:14.454433 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.460979 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.470496 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:14.471239 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:22:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:14.532777 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Pushing event updated for resources: {'Port': ['ID=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:14.535457 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.556085 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c2a50c0-cada-4f33-991e-a76434b44865 None None] Pushing event updated for resources: {'Port': ['ID=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:14.596659 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:14.641079 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Network 55d54831-cf2b-4880-8018-9fcb1b176026 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:14.642735 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:14.793492 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Router 95164b65-5103-4ebd-944c-7883a34b1f32 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:23:14.898529 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-dcc16b76-5d9e-49a1-8a93-0939712f6136 None None] Provisioning complete for port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:14.898882 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dcc16b76-5d9e-49a1-8a93-0939712f6136 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:14.916260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:14.929768 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7632c6e6-9f58-4228-958e-8cfa07f686f4 admin admin] 10.222.0.31 "PUT /v2.0/routers/95164b65-5103-4ebd-944c-7883a34b1f32/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2077124 Nov 16 03:23:14.975246 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-dcc16b76-5d9e-49a1-8a93-0939712f6136 None None] Port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:23:15.003643 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 2, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:15.031306 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99bd4291-fe45-42d4-b676-fcec21333f14 None None] The sync data for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi is: [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 2, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:15.355444 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device d3a5a2fa-7f90-4061-a114-c658b9a021d9 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:15.453468 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port d3a5a2fa-7f90-4061-a114-c658b9a021d9 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:15.454378 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.553872 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de49c2d0-57dc-4660-b1c6-bb70d4c86ceb req-cf328b6b-cb74-442b-87af-6e9e59ec388a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:15.562043 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de49c2d0-57dc-4660-b1c6-bb70d4c86ceb req-cf328b6b-cb74-442b-87af-6e9e59ec388a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0662603 Nov 16 03:23:15.590594 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49144) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:15.599902 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1917360307-network', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:15.632534 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de49c2d0-57dc-4660-b1c6-bb70d4c86ceb req-4527111f-65a3-4f00-bec7-62ba14d0edc6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0565674 Nov 16 03:23:15.636456 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Made reservation on behalf of e8cfa442410048ee8abafea0f22e1fa1 for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:23:15.638993 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.649468 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.747425 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.752874 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.781934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 340} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:23:15.800637 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.800886 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Added segment 948dba33-d4b0-4641-84f6-64602f61b447 of type vlan for network 414c4d8f-83b9-4da8-9892-d3997dac8c10 Nov 16 03:23:15.847222 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.851483 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4dca61a3-4575-411c-9692-bd656d562ccc,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:15.913970 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.915264 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:15.915899 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:15.989681 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3971026 Nov 16 03:23:15.994944 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49156) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:15.997110 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04d7aed-4ac1-494f-b4f0-18d0211c4cca admin admin] Pushing event updated for resources: {'Network': ['ID=414c4d8f-83b9-4da8-9892-d3997dac8c10,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:16.001585 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Request body: {'subnet': {'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1917360307-subnet', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:16.013328 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:23:16.028599 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Made reservation on behalf of e8cfa442410048ee8abafea0f22e1fa1 for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:23:16.031223 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.187704 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49164) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:16.293285 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-f24291f3-c099-45a2-aded-c807184d4ed1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1034913 Nov 16 03:23:16.305373 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-977c0576-c440-4011-96f5-552572d85ab1 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101898) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:23:16.307080 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-977c0576-c440-4011-96f5-552572d85ab1 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0080628 Nov 16 03:23:16.330999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.392121 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c9103af4-17d4-43a4-b652-54ffc4cebd37,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:16.405082 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.405447 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.405780 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.406125 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.406582 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.406751 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.407071 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.407401 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.407709 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.408023 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.408684 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.408993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:16.416307 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Checking segment: {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:16.416658 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Network hostable DHCP agents. Network: 414c4d8f-83b9-4da8-9892-d3997dac8c10, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:23:16.440887 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:23:16.459697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, 414c4d8f-83b9-4da8-9892-d3997dac8c10) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:16.468424 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:16.469958 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.478359 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4baf45b-90a7-46e4-ab56-10b238928b89 None None] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:23:16.508064 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-53c03229-b98d-4e6f-8092-f15fcf708476 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5068996 Nov 16 03:23:16.508064 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49172) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:16.512717 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:16.542479 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.543929 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.649012 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.714228 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-414c4d8f-83b9-4da8-9892-d3997dac8c10', 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'fixed_ips': [{'subnet_id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:23:16.715705 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:16.917936 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Allocated IP 172.20.0.2 (414c4d8f-83b9-4da8-9892-d3997dac8c10/c9103af4-17d4-43a4-b652-54ffc4cebd37/b27ed6ef-2972-4e23-902e-fe4102c95492) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:17.093270 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.100740 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.110213 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.132811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaab3ea-f27d-41b7-a912-045d54bf1a9e req-aa37c4e3-9083-40f5-9e0d-b9b85e6e2e0d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:17.140128 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:17.141378 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4aaab3ea-f27d-41b7-a912-045d54bf1a9e req-aa37c4e3-9083-40f5-9e0d-b9b85e6e2e0d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.3758290 Nov 16 03:23:17.147565 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:17.151403 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:17.159808 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Pushing event updated for resources: {'Port': ['ID=b27ed6ef-2972-4e23-902e-fe4102c95492,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:17.222448 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Attempting to bind port b27ed6ef-2972-4e23-902e-fe4102c95492 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:17.223860 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Attempting to bind port b27ed6ef-2972-4e23-902e-fe4102c95492 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:17.224327 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Attempting to bind port b27ed6ef-2972-4e23-902e-fe4102c95492 on network 414c4d8f-83b9-4da8-9892-d3997dac8c10 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:17.231076 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 22, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:17.231595 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Checking segment: {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:17.232951 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.234562 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Bound using segment: {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:17.235212 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Bound port: b27ed6ef-2972-4e23-902e-fe4102c95492, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:17.235637 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.243609 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4aaab3ea-f27d-41b7-a912-045d54bf1a9e req-ecfe1e8e-0a5c-40f8-865d-475c84bf2d52 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1006370 Nov 16 03:23:17.275664 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:17.409945 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:17.457067 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] For port b27ed6ef-2972-4e23-902e-fe4102c95492, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:17.461093 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] For port b27ed6ef-2972-4e23-902e-fe4102c95492, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=b27ed6ef-2972-4e23-902e-fe4102c95492,segment=NetworkSegment(948dba33-d4b0-4641-84f6-64602f61b447),segment_id=948dba33-d4b0-4641-84f6-64602f61b447)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:17.476209 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.559008 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0461d971-2424-43f2-982d-e60ac223db35 req-8de2bec2-1b2a-4793-9e5f-af87d4782abf tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:17.562001 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0461d971-2424-43f2-982d-e60ac223db35 req-8de2bec2-1b2a-4793-9e5f-af87d4782abf tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.1394467 Nov 16 03:23:17.568162 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.583407 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91a69ee5-c1a6-44e7-b654-b56fd03bc1e5 None None] Pushing event updated for resources: {'Port': ['ID=b27ed6ef-2972-4e23-902e-fe4102c95492,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:17.592993 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:17.593658 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.595687 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.710222 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0461d971-2424-43f2-982d-e60ac223db35 req-ac8334c2-f27d-4646-9f4d-53f2855b2f12 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1180160 Nov 16 03:23:17.742560 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.770030 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:17.778944 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:17.862546 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Allocated IP 172.27.1.145 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/c24d0c4e-4dd2-4fad-bba5-0e821be0b450) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:17.909752 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Sync routers for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:17.925250 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:17.948141 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:17.949794 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:22:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:18.068674 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.119670 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.151489 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:18.162037 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:18.167295 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:18.172333 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:18.175842 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Pushing event updated for resources: {'Port': ['ID=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:18.404487 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 2, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:18.425267 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b13c1bd-13fb-4e8c-bf8a-e666c7bc8bf0 req-e4d6144a-814a-4919-96b8-6fe7359d5085 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:18.428600 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3b13c1bd-13fb-4e8c-bf8a-e666c7bc8bf0 req-e4d6144a-814a-4919-96b8-6fe7359d5085 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0922520 Nov 16 03:23:18.451329 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6f246689-3896-4658-a6cc-5282fbeb0eb0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.555056 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Checking router: 95164b65-5103-4ebd-944c-7883a34b1f32 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:18.555472 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Updating router 95164b65-5103-4ebd-944c-7883a34b1f32 port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:23:18.609773 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.631293 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3b13c1bd-13fb-4e8c-bf8a-e666c7bc8bf0 req-1683d6d7-a089-4fd2-ad34-3bff915835ec tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1205130 Nov 16 03:23:18.646698 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.850737 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aee67dd9-5f41-4069-8b8e-508426f147e2 None None] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:23:18.921654 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb8b61e-cd06-448b-8060-85dbe1706cca req-64d0bc37-45bd-4005-b7dd-a1c17f10b103 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:18.923271 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7cb8b61e-cd06-448b-8060-85dbe1706cca req-64d0bc37-45bd-4005-b7dd-a1c17f10b103 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.1360900 Nov 16 03:23:18.939678 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.947072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-6cb310f7-83f2-4d13-9d11-f8d02185ab5a None None] Provisioning complete for port b27ed6ef-2972-4e23-902e-fe4102c95492 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:18.947740 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6cb310f7-83f2-4d13-9d11-f8d02185ab5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.983274 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:18.992191 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.049007 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Pushing event updated for resources: {'Port': ['ID=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:19.058271 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.058708 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.059065 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.059389 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.059713 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.060446 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.060636 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.060881 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.061157 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.061508 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.062323 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.062323 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:23:19.070225 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7cb8b61e-cd06-448b-8060-85dbe1706cca req-fbec2731-c7c7-4874-89a5-4d3f0e407d57 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1242216 Nov 16 03:23:19.071954 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6cb310f7-83f2-4d13-9d11-f8d02185ab5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.120802 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Attempting to bind port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:19.121169 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Attempting to bind port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:19.121553 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Attempting to bind port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 on network 55d54831-cf2b-4880-8018-9fcb1b176026 {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:19.128559 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 22, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:19.128926 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Checking segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:19.129335 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.129765 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Bound using segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:19.130243 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Bound port: 978b43ed-a3a9-4d7a-a84a-b769fec14fc7, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:19.130643 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.181836 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-6cb310f7-83f2-4d13-9d11-f8d02185ab5a None None] For port b27ed6ef-2972-4e23-902e-fe4102c95492, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=b27ed6ef-2972-4e23-902e-fe4102c95492,segment=NetworkSegment(948dba33-d4b0-4641-84f6-64602f61b447),segment_id=948dba33-d4b0-4641-84f6-64602f61b447)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:19.185052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101899) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:23:19.189543 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6cb310f7-83f2-4d13-9d11-f8d02185ab5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.280138 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cb310f7-83f2-4d13-9d11-f8d02185ab5a None None] Pushing event updated for resources: {'Port': ['ID=b27ed6ef-2972-4e23-902e-fe4102c95492,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:19.323132 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] For port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:19.330194 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] For port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:19.339854 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.408697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:19.419613 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Sync routers for ids ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:19.437867 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.439318 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Routers {'d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:19.440092 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-167516e1-0131-4c88-b2b0-9265766ed99a admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.9308908 Nov 16 03:23:19.440488 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:19.442813 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49210) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:19.466726 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:19.467585 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:19.537544 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb9d5af-7b70-4d1f-9df8-f5572dc062b0 None None] Pushing event updated for resources: {'Port': ['ID=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,revision_number=4']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:19.628132 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:19.638981 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-a74848be-ea64-40b4-ba12-21f2df98a6d1 None None] Provisioning complete for port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:19.639576 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a74848be-ea64-40b4-ba12-21f2df98a6d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.892290 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:19.907218 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-925bd71f-645a-4af9-9bc8-3a235cef102b req-4ed36b48-e2eb-4047-a5b1-3b66d57405b1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:19.919015 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-925bd71f-645a-4af9-9bc8-3a235cef102b req-4ed36b48-e2eb-4047-a5b1-3b66d57405b1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.1182716 Nov 16 03:23:19.921176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Set router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:19.926424 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:19.938043 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:19Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:19.965319 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c891ce5e-3d8c-4fb8-9383-7a8f7a58bda2 None None] The sync data for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi is: [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:19Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:19.984422 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-925bd71f-645a-4af9-9bc8-3a235cef102b req-dbc3f9ab-6b57-4f7f-b788-29654277448b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0642014 Nov 16 03:23:20.131027 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a74848be-ea64-40b4-ba12-21f2df98a6d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.186609 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.195677 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:20.196052 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.236134 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3973f7c-48de-4477-b74c-0d0c131839cc req-fcd75ae9-d708-4496-8cba-55d6e1b3844d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:20.237753 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3973f7c-48de-4477-b74c-0d0c131839cc req-fcd75ae9-d708-4496-8cba-55d6e1b3844d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.0576961 Nov 16 03:23:20.253700 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-a74848be-ea64-40b4-ba12-21f2df98a6d1 None None] For port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:20.264105 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a74848be-ea64-40b4-ba12-21f2df98a6d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.323262 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3973f7c-48de-4477-b74c-0d0c131839cc req-2764abbf-cf54-4cd4-b027-dcd8de7fc227 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715861 Nov 16 03:23:20.337029 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74848be-ea64-40b4-ba12-21f2df98a6d1 None None] Pushing event updated for resources: {'Port': ['ID=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:20.395244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device b27ed6ef-2972-4e23-902e-fe4102c95492 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:20.400625 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:23:18Z', 'revision_number': 3, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:20.436914 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Allocated IP 172.20.0.1 (414c4d8f-83b9-4da8-9892-d3997dac8c10/c9103af4-17d4-43a4-b652-54ffc4cebd37/43675894-06ff-4b28-988f-09322b5b4dcb) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:20.588939 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-92b38195-93b3-4040-ab0d-a39d766e4185 None None] Provisioning complete for port b27ed6ef-2972-4e23-902e-fe4102c95492 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:20.589314 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-92b38195-93b3-4040-ab0d-a39d766e4185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.597052 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Checking router: d7cf3d4a-7ecb-4adc-933f-e56913fcc87f for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:20.597987 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Updating router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:23:20.599858 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.639250 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.667491 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.691878 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:20.695396 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:20.700591 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:20.736418 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Pushing event updated for resources: {'Port': ['ID=43675894-06ff-4b28-988f-09322b5b4dcb,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:20.745643 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.811098 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port b27ed6ef-2972-4e23-902e-fe4102c95492 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:20.811098 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.938826 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-92b38195-93b3-4040-ab0d-a39d766e4185 None None] Provisioning complete for port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:20.939201 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-92b38195-93b3-4040-ab0d-a39d766e4185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:20.979908 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.129625 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e73a2e-95ea-4117-94fe-31586d9809d5 req-2d2ab215-40fd-40b6-9847-7dcadb6016a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:21.131589 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6e73a2e-95ea-4117-94fe-31586d9809d5 req-2d2ab215-40fd-40b6-9847-7dcadb6016a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0559306 Nov 16 03:23:21.180639 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.186264 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.210399 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6e73a2e-95ea-4117-94fe-31586d9809d5 req-e86f743e-c565-4eb5-ace3-2b78f89bd753 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691111 Nov 16 03:23:21.241006 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.255493 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.273982 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.321420 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Pushing event updated for resources: {'Port': ['ID=43675894-06ff-4b28-988f-09322b5b4dcb,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:21.332779 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:21.399388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:21.402094 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:21.405360 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba1cd574-d255-4d0b-b96d-f6e2102eeeab None None] Pushing event updated for resources: {'Port': ['ID=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:21.425069 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:21.459124 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d146f59-b07d-4662-8dd6-d4fcb72d32a7 req-94235670-4a15-408e-894c-cc6b9d22a187 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:21.460681 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1d146f59-b07d-4662-8dd6-d4fcb72d32a7 req-94235670-4a15-408e-894c-cc6b9d22a187 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 945 time: 0.0683267 Nov 16 03:23:21.464642 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Attempting to bind port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:21.465112 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Attempting to bind port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:21.465535 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Attempting to bind port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:21.488962 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-94b769d0-5756-4913-aafb-aa46d4427d09 None None] Provisioning complete for port 43675894-06ff-4b28-988f-09322b5b4dcb triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:21.489325 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-94b769d0-5756-4913-aafb-aa46d4427d09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.494292 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 22, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:21.494292 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:21.494642 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.495027 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:21.495517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Bound port: c24d0c4e-4dd2-4fad-bba5-0e821be0b450, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:21.496077 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.532084 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1d146f59-b07d-4662-8dd6-d4fcb72d32a7 req-e30a5bec-465b-4674-ba97-2b72f9de4862 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633085 Nov 16 03:23:21.558435 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:23:21.617680 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.652718 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-94b769d0-5756-4913-aafb-aa46d4427d09 None None] Port 43675894-06ff-4b28-988f-09322b5b4dcb cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:23:21.664328 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.673983 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.681454 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] For port c24d0c4e-4dd2-4fad-bba5-0e821be0b450, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:21.684478 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:21.684888 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.688247 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] For port c24d0c4e-4dd2-4fad-bba5-0e821be0b450, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:21.708243 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:21.713365 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f511efba-9365-4600-a59f-bae74b1506f9 admin admin] 10.222.0.31 "PUT /v2.0/routers/d7cf3d4a-7ecb-4adc-933f-e56913fcc87f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2694974 Nov 16 03:23:21.737027 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.814641 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:21.816926 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9211d4ae-a070-46fb-88ca-4bfa51249c37" -d '{"events": [{"server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "name": "network-vif-unplugged", "status": "completed", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:21.874660 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2d79eb5-d18b-4c38-89ac-60263982283d x-openstack-request-id: req-a2d79eb5-d18b-4c38-89ac-60263982283d {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:21.874995 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "name": "network-vif-unplugged", "status": "completed", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:21.875220 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a2d79eb5-d18b-4c38-89ac-60263982283d {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:21.875606 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'code': 200} Nov 16 03:23:21.879555 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:21.890250 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Routers {'d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:21.890823 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:21.893075 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba1cd574-d255-4d0b-b96d-f6e2102eeeab None None] Pushing event updated for resources: {'Port': ['ID=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:21.898392 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.937865 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-b13f455e-4cce-493e-9edf-1080d11a4292 None None] Provisioning complete for port 43675894-06ff-4b28-988f-09322b5b4dcb triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:21.938236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b13f455e-4cce-493e-9edf-1080d11a4292 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:21.979679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49244) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:22.066333 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-b13f455e-4cce-493e-9edf-1080d11a4292 None None] Port 43675894-06ff-4b28-988f-09322b5b4dcb cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:23:22.108195 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=6']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:22.136677 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-002ed071-5c7b-4c43-9049-d845b832fe3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.164157 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] Set router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:22.169268 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device b27ed6ef-2972-4e23-902e-fe4102c95492 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:22.243695 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-002ed071-5c7b-4c43-9049-d845b832fe3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.250263 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-002ed071-5c7b-4c43-9049-d845b832fe3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.306133 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-002ed071-5c7b-4c43-9049-d845b832fe3a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=9e7e90df19c94742bc534164c49e5101&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3253076 Nov 16 03:23:22.306995 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002ed071-5c7b-4c43-9049-d845b832fe3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c8a7c71-ff90-45c7-ad3e-4b91dc4dfb92,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:22.312382 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49250) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:22.367010 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7230aac1-156b-4859-81b9-64340f61e167 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.369729 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8eda98-d23c-482c-a802-f8efc5d5d307 req-a52a8773-e011-4b51-a0cc-7f644e4434f6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:22.377682 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0c8eda98-d23c-482c-a802-f8efc5d5d307 req-a52a8773-e011-4b51-a0cc-7f644e4434f6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0773268 Nov 16 03:23:22.394403 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7230aac1-156b-4859-81b9-64340f61e167 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.440087 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0c8eda98-d23c-482c-a802-f8efc5d5d307 req-cb8d8eee-5f40-46cf-8589-f6f5c1ffc5d3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566094 Nov 16 03:23:22.468013 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7230aac1-156b-4859-81b9-64340f61e167 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.471246 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7230aac1-156b-4859-81b9-64340f61e167 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.472485 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7230aac1-156b-4859-81b9-64340f61e167 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/5c8a7c71-ff90-45c7-ad3e-4b91dc4dfb92 HTTP/1.1" status: 204 len: 168 time: 0.1590536 Nov 16 03:23:22.481887 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port b27ed6ef-2972-4e23-902e-fe4102c95492 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:22.482339 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.499637 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7230aac1-156b-4859-81b9-64340f61e167 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c8a7c71-ff90-45c7-ad3e-4b91dc4dfb92,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:22.609611 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-25d1d686-bb5d-400f-9bb1-b6f88d48eadd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:22.611399 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-25d1d686-bb5d-400f-9bb1-b6f88d48eadd service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e&tenant_id=2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 1097 time: 0.0961218 Nov 16 03:23:22.623616 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '43675894-06ff-4b28-988f-09322b5b4dcb', 'name': '', 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'mac_address': 'fa:16:3e:a9:c9:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_interface', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:20Z', 'updated_at': '2021-11-16T03:23:21Z', 'revision_number': 2, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'subnets': [{'id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:22.657338 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7598d24-7f14-47f6-a084-63cfd07bbe41 None None] The sync data for ids ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'] in dv-cinder-818037-1-iscsi is: [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '43675894-06ff-4b28-988f-09322b5b4dcb', 'name': '', 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'mac_address': 'fa:16:3e:a9:c9:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_interface', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:20Z', 'updated_at': '2021-11-16T03:23:21Z', 'revision_number': 2, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'subnets': [{'id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:22.739797 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-ba3aeb65-fa9e-4ec4-8c9c-0628de57067a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:22.744049 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-ba3aeb65-fa9e-4ec4-8c9c-0628de57067a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1097 time: 0.0754519 Nov 16 03:23:22.761040 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8413f748-ae85-4273-b9a1-c5d6301152f1 req-c377105e-4a5f-47dc-8d6d-fdf18ee498f5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:22.764001 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8413f748-ae85-4273-b9a1-c5d6301152f1 req-c377105e-4a5f-47dc-8d6d-fdf18ee498f5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.1101475 Nov 16 03:23:22.867638 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49256) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:22.874270 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1457425326', 'description': 'tempest-secgroup-smoke-1457425326 description', 'project_id': '2ea0808579e44cdcaeba4109bc12863b'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:22.885837 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8413f748-ae85-4273-b9a1-c5d6301152f1 req-fc148884-36c2-4e71-ad5f-4b85b76948e5 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1040068 Nov 16 03:23:22.912844 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:22.927640 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-840c5fa9-5fec-44e6-aeb9-1cca94973122 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:22.929227 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-840c5fa9-5fec-44e6-aeb9-1cca94973122 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.1735871 Nov 16 03:23:23.028724 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-96a78a51-8426-4c06-9a89-bf8a6f5204a9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 1000 time: 0.0907075 Nov 16 03:23:23.042151 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.049989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.087495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.092346 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2233872 Nov 16 03:23:23.097635 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49258) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:23.102627 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group_rule': {'security_group_id': 'e87cca3f-4826-407f-8ec0-d093b4170bee', 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:23.110385 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1276b54b-0ba4-44a0-9aa7-9c69560663fc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e87cca3f-4826-407f-8ec0-d093b4170bee,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:23.127854 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-53e59dcd-155a-485e-8d14-b9a09758156e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:23.131264 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-53e59dcd-155a-485e-8d14-b9a09758156e service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0948501 Nov 16 03:23:23.160737 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.205166 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-9bd3c177-b433-4816-859a-f2b800106f95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:23.208044 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-9bd3c177-b433-4816-859a-f2b800106f95 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0685565 Nov 16 03:23:23.257257 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.264503 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.299241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ea382cb-89bf-40b8-82f6-02604d01d97f,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:23.317168 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.319939 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-02f94d98-dfb1-47ef-bbbe-1217d1342b18 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2205846 Nov 16 03:23:23.324927 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49260) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:23.336229 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group_rule': {'security_group_id': 'e87cca3f-4826-407f-8ec0-d093b4170bee', 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:23.400188 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-b2d37ed9-ff28-44fc-8970-a07dc727db8b service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1841567 Nov 16 03:23:23.409501 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.533971 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.541733 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.568722 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-decf7b6b-5011-4904-a26b-98aba7fc1077 req-137f3f8b-d2cb-46ac-a1bd-aca85ed67c84 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1606970 Nov 16 03:23:23.570659 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=beb5bf76-d72d-439a-a246-ea8bbb710333,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:23.591512 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.592790 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c534062e-058a-460d-9312-f85436fb5ac8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2665005 Nov 16 03:23:23.597097 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49264) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:23.605683 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group_rule': {'security_group_id': 'e87cca3f-4826-407f-8ec0-d093b4170bee', 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:23.686659 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ac4c38-1aae-4505-bbac-6ab3a9b32cf1 req-01060cad-f4c5-4ba7-83b6-91e0765f376c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:23.688374 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a9ac4c38-1aae-4505-bbac-6ab3a9b32cf1 req-01060cad-f4c5-4ba7-83b6-91e0765f376c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.1236634 Nov 16 03:23:23.714717 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.765270 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a9ac4c38-1aae-4505-bbac-6ab3a9b32cf1 req-4385de32-febe-4931-8f1b-30e71c63b281 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0556180 Nov 16 03:23:23.819529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.827074 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.847576 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ef9f33e0-07d8-4a8a-b2af-722a762c0a20,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:23.861407 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:23.863205 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-a149b6c4-2a91-49b6-9fd5-294d85b3f5b6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2644191 Nov 16 03:23:23.866456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49272) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:23.872039 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group_rule': {'security_group_id': 'e87cca3f-4826-407f-8ec0-d093b4170bee', 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:23.915097 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.016520 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.028374 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.045623 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-51fbcb14-f2b1-45de-8e78-6315e02c0325 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:24.047363 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-51fbcb14-f2b1-45de-8e78-6315e02c0325 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.0694096 Nov 16 03:23:24.063412 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5cc606-c54b-4699-892e-75ba5e5d63a6 req-831e3243-8717-458c-be68-7c9096a622d2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:24.072161 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fe5cc606-c54b-4699-892e-75ba5e5d63a6 req-831e3243-8717-458c-be68-7c9096a622d2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 943 time: 0.1093676 Nov 16 03:23:24.087790 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0f622aa-b247-48b8-92e1-4524ac38c0bf,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:24.162683 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fe5cc606-c54b-4699-892e-75ba5e5d63a6 req-00268219-c873-438e-ac1b-87d4e1fcd50b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0883267 Nov 16 03:23:24.168970 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.179485 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49284) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:24.179682 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f31481e4-b0cc-48b7-abb5-cf22779a7a52 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3025575 Nov 16 03:23:24.179785 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group_rule': {'security_group_id': 'e87cca3f-4826-407f-8ec0-d093b4170bee', 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:24.219898 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.securitygroups_db [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Project 2ea0808579e44cdcaeba4109bc12863b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 16 03:23:24.234256 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.251253 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Deleting port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:23:24.251775 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.399982 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.414450 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.435098 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] For port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:24.435454 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.459198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d45f825a-f528-4bc4-9048-74d0ed4d0d6c,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:24.552398 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.561214 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49292) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:24.570487 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'security_group_rule': {'security_group_id': 'e87cca3f-4826-407f-8ec0-d093b4170bee', 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:24.579457 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3b41b3c9-afa9-461b-844a-e8b8444c881a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4022646 Nov 16 03:23:24.633919 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.securitygroups_db [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Project 2ea0808579e44cdcaeba4109bc12863b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 16 03:23:24.640864 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.750943 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.756177 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.791611 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63e2e44f-fabd-45bf-bf97-6edf177a3764,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:24.798624 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.808978 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-c31bebc7-e251-4a51-b83c-6fa6e7605bf2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2370408 Nov 16 03:23:24.923533 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.924592 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:24.925072 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.l3_db [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Floating IP 603af913-04dd-45aa-b688-4ca042282370 disassociated. External IP: 172.27.1.157, port: 708ca4dc-7d1f-4191-b1d2-fe81df173fc1. Nov 16 03:23:24.925942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Calling delete_port for 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 owned by compute:nova {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:23:25.049914 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe43208-4ea5-462b-b08e-75650f2b220f req-be8497e8-3f09-42b2-b2a9-20ffd2411f59 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:25.061255 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dbe43208-4ea5-462b-b08e-75650f2b220f req-be8497e8-3f09-42b2-b2a9-20ffd2411f59 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0816467 Nov 16 03:23:25.161683 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dbe43208-4ea5-462b-b08e-75650f2b220f req-5d783b19-9af6-4b90-be78-f5c7f04de30a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0983360 Nov 16 03:23:25.195404 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:25.232988 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'Port': ['ID=708ca4dc-7d1f-4191-b1d2-fe81df173fc1,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:25.378192 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-79077bb9-f5df-43cf-a971-5ad455256980 req-7d8c3cf1-1f2e-4059-b814-41d1e19a8efc tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0868444 Nov 16 03:23:25.452787 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device c24d0c4e-4dd2-4fad-bba5-0e821be0b450 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:25.748148 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:25.748931 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:25.927564 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:23:25.930750 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:25.994380 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port c24d0c4e-4dd2-4fad-bba5-0e821be0b450, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:26.013350 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:26.098888 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:26.167955 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:26.181383 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:26.194083 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:26.195523 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:26.280309 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] No DVR routers for this DVR port 708ca4dc-7d1f-4191-b1d2-fe81df173fc1 on host hv-cinder-81803 {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:23:26.287199 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:26.290674 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-7db479dd-56c2-4699-b730-e2e3c58036b5 req-c90fb2f9-f850-4285-9cd5-8e58a3334f35 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "DELETE /v2.0/ports/708ca4dc-7d1f-4191-b1d2-fe81df173fc1 HTTP/1.1" status: 204 len: 173 time: 2.2364597 Nov 16 03:23:26.291218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'name': 'network-vif-deleted', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:26.293660 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85963270-9a42-41b1-a7bd-91d6a081aa2b" -d '{"events": [{"server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "name": "network-vif-deleted", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:26.410795 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30d4b389-1fb2-40db-bb82-25827c5be899 x-openstack-request-id: req-30d4b389-1fb2-40db-bb82-25827c5be899 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:26.411281 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05a570bf-47a2-4a56-ac98-b33b4d4ad565", "name": "network-vif-deleted", "tag": "708ca4dc-7d1f-4191-b1d2-fe81df173fc1", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:26.411694 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-30d4b389-1fb2-40db-bb82-25827c5be899 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:26.412229 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05a570bf-47a2-4a56-ac98-b33b4d4ad565', 'name': 'network-vif-deleted', 'tag': '708ca4dc-7d1f-4191-b1d2-fe81df173fc1', 'status': 'completed', 'code': 200} Nov 16 03:23:26.492825 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:26.509271 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4677811e-37d5-47d7-a99d-8afe6b33df4b req-a3413a35-3014-420a-99d5-c88168fd0038 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:26.510884 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4677811e-37d5-47d7-a99d-8afe6b33df4b req-a3413a35-3014-420a-99d5-c88168fd0038 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.1487238 Nov 16 03:23:26.599473 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e5ffdf6-3432-447d-8005-a8698d39219f req-d2954324-0aec-46cb-9533-bb8e84368d5b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0466719 Nov 16 03:23:26.617783 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4677811e-37d5-47d7-a99d-8afe6b33df4b req-e09ad5af-1fb7-46c2-90be-7806837368e0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0999916 Nov 16 03:23:26.899678 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:26.970765 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:26.988541 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:26.989936 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:27.146465 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:27.232354 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Sync routers for ids ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:27.270372 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Routers {'d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:27.271042 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:27.462587 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device c24d0c4e-4dd2-4fad-bba5-0e821be0b450 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:27.555608 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:27.571977 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:27.572638 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:27.629512 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Set router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:27.799285 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daa37d36-d2c5-4cd0-90fd-e4e8ea3d00a2 None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:27.818273 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f584b033-2e0a-40f5-99ea-6bc0b0352165 req-d43c594b-142a-407c-913a-3ae37ae09a18 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0702055 Nov 16 03:23:27.936840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea136f3-2bd0-486c-a16c-70f6a340502e req-08fcbcb5-7057-4a86-b646-841a30c684de tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:27.938472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dea136f3-2bd0-486c-a16c-70f6a340502e req-08fcbcb5-7057-4a86-b646-841a30c684de tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.1159689 Nov 16 03:23:28.086327 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dea136f3-2bd0-486c-a16c-70f6a340502e req-1d891240-d8c3-41ec-b0f7-334c9c9f900c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1413512 Nov 16 03:23:28.195432 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '43675894-06ff-4b28-988f-09322b5b4dcb', 'name': '', 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'mac_address': 'fa:16:3e:a9:c9:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_interface', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:20Z', 'updated_at': '2021-11-16T03:23:21Z', 'revision_number': 2, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'subnets': [{'id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:28.296613 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Checking router: d7cf3d4a-7ecb-4adc-933f-e56913fcc87f for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:28.298287 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Updating router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f port 43675894-06ff-4b28-988f-09322b5b4dcb binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:23:28.344192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:28.367875 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8242b2a-818c-4e65-9df2-ca1c8fd2cdd7 None None] New status for floating IP 603af913-04dd-45aa-b688-4ca042282370: DOWN {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:23:28.807612 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:28.818796 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:28.890714 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ff9a65-ab27-4d46-8f83-54f78cd94257 None None] Pushing event updated for resources: {'Port': ['ID=43675894-06ff-4b28-988f-09322b5b4dcb,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:28.980341 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-22de5abe-f69a-47ea-912d-facfd2dd8a40 req-8651fdcb-3d37-43a4-addf-4e458f80e039 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0608814 Nov 16 03:23:29.009395 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Attempting to bind port 43675894-06ff-4b28-988f-09322b5b4dcb on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:29.009844 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Attempting to bind port 43675894-06ff-4b28-988f-09322b5b4dcb by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:29.010267 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Attempting to bind port 43675894-06ff-4b28-988f-09322b5b4dcb on network 414c4d8f-83b9-4da8-9892-d3997dac8c10 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:29.017534 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 23, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:29.018081 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Checking segment: {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:29.018293 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:29.018736 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Bound using segment: {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:29.019278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Bound port: 43675894-06ff-4b28-988f-09322b5b4dcb, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '948dba33-d4b0-4641-84f6-64602f61b447', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 340, 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:29.019723 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:29.128308 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] For port 43675894-06ff-4b28-988f-09322b5b4dcb, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:29.140755 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] For port 43675894-06ff-4b28-988f-09322b5b4dcb, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=43675894-06ff-4b28-988f-09322b5b4dcb,segment=NetworkSegment(948dba33-d4b0-4641-84f6-64602f61b447),segment_id=948dba33-d4b0-4641-84f6-64602f61b447)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:29.147980 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:29.250748 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ff9a65-ab27-4d46-8f83-54f78cd94257 None None] Pushing event updated for resources: {'Port': ['ID=43675894-06ff-4b28-988f-09322b5b4dcb,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:29.326987 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-edfeb704-9254-4096-9fb6-ee1c71f17c52 None None] Provisioning complete for port 43675894-06ff-4b28-988f-09322b5b4dcb triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:29.332462 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-edfeb704-9254-4096-9fb6-ee1c71f17c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:29.385993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4793738d-e6c9-4a1e-ba28-a5cc66c123bc req-6207e053-bcbd-46db-9e3c-7356775e1a33 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:29.400003 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4793738d-e6c9-4a1e-ba28-a5cc66c123bc req-6207e053-bcbd-46db-9e3c-7356775e1a33 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.1452014 Nov 16 03:23:29.435982 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 43675894-06ff-4b28-988f-09322b5b4dcb up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:29.490590 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Routers {'d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:29.491242 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:29.498576 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4793738d-e6c9-4a1e-ba28-a5cc66c123bc req-7dc45281-3b59-4f73-99af-782eb2347d3e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0975163 Nov 16 03:23:29.699590 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-edfeb704-9254-4096-9fb6-ee1c71f17c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:29.703391 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 43675894-06ff-4b28-988f-09322b5b4dcb triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:29.703752 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:29.706486 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] Set router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:29.842063 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-edfeb704-9254-4096-9fb6-ee1c71f17c52 None None] For port 43675894-06ff-4b28-988f-09322b5b4dcb, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=43675894-06ff-4b28-988f-09322b5b4dcb,segment=NetworkSegment(948dba33-d4b0-4641-84f6-64602f61b447),segment_id=948dba33-d4b0-4641-84f6-64602f61b447)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:29.861606 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-edfeb704-9254-4096-9fb6-ee1c71f17c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:30.109486 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfeb704-9254-4096-9fb6-ee1c71f17c52 None None] Pushing event updated for resources: {'Port': ['ID=43675894-06ff-4b28-988f-09322b5b4dcb,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:30.129050 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-04c91f3c-1db9-4af4-b0d9-f24a0dfa7889 None None] Provisioning complete for port 43675894-06ff-4b28-988f-09322b5b4dcb triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:30.129415 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04c91f3c-1db9-4af4-b0d9-f24a0dfa7889 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:30.136371 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-af36a10d-3e34-43ca-bc87-59dacb037ba0 req-22f81b80-8b5c-4b33-8cfa-0f8837626f61 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0537753 Nov 16 03:23:30.389197 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '43675894-06ff-4b28-988f-09322b5b4dcb', 'name': '', 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'mac_address': 'fa:16:3e:a9:c9:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_interface', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:20Z', 'updated_at': '2021-11-16T03:23:29Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'subnets': [{'id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:30.429101 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760e98b9-5c00-4b0e-b24f-7f61e519aa6d None None] The sync data for ids ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'] in dv-cinder-818037-1-iscsi is: [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '43675894-06ff-4b28-988f-09322b5b4dcb', 'name': '', 'network_id': '414c4d8f-83b9-4da8-9892-d3997dac8c10', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'mac_address': 'fa:16:3e:a9:c9:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_interface', 'standard_attr_id': 613, 'fixed_ips': [{'subnet_id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:20Z', 'updated_at': '2021-11-16T03:23:29Z', 'revision_number': 4, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'subnets': [{'id': 'c9103af4-17d4-43a4-b652-54ffc4cebd37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:30.676254 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d538d26-f3de-4d67-8958-40d00860369e req-23b00057-fbe1-46e7-9795-26b25c9386d7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:30.678191 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2d538d26-f3de-4d67-8958-40d00860369e req-23b00057-fbe1-46e7-9795-26b25c9386d7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0809319 Nov 16 03:23:30.761841 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2d538d26-f3de-4d67-8958-40d00860369e req-c5587b9d-cfb7-4576-aa4a-738def3fb08c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767696 Nov 16 03:23:31.325702 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13504066-21b1-42b9-a110-3e93edd5dd69 req-3cf101b9-c4ad-44fb-ab4c-0fa19de18c84 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0381045 Nov 16 03:23:31.391246 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 43675894-06ff-4b28-988f-09322b5b4dcb up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:31.444045 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 43675894-06ff-4b28-988f-09322b5b4dcb triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:31.444419 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:31.922559 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17553cbf-dbc1-482e-b05e-808ad47f7c0b req-5bb1effa-1bf6-4e04-badf-40b7f63a68d6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:31.927926 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17553cbf-dbc1-482e-b05e-808ad47f7c0b req-5bb1effa-1bf6-4e04-badf-40b7f63a68d6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0738099 Nov 16 03:23:31.985310 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17553cbf-dbc1-482e-b05e-808ad47f7c0b req-36ac8f0f-f97f-4061-aa49-8693742cc57a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493035 Nov 16 03:23:32.446123 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-edc568bc-0a0e-4c14-893b-75091167d822 req-d300cef0-f87f-42ce-8d5e-27a7eae22999 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0322104 Nov 16 03:23:33.138496 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd00e1fb-b977-425f-9422-cc7d7570193a req-584e1275-451a-43a3-b195-688d855f72f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:33.140016 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd00e1fb-b977-425f-9422-cc7d7570193a req-584e1275-451a-43a3-b195-688d855f72f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0632455 Nov 16 03:23:33.210332 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd00e1fb-b977-425f-9422-cc7d7570193a req-22cb856d-af11-43c3-a842-8d7164cce0d2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0634882 Nov 16 03:23:33.579289 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3ea89053-806d-4ea9-b612-4d082295a5ef req-e04355ae-5f50-4a9c-ac51-d7c36147e32f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0398912 Nov 16 03:23:34.363587 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3583b1-2e3a-4b36-814f-5306bc056dcb req-598211d2-0f1a-430d-aa25-438164559120 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:34.365066 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b3583b1-2e3a-4b36-814f-5306bc056dcb req-598211d2-0f1a-430d-aa25-438164559120 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0573175 Nov 16 03:23:34.432212 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b3583b1-2e3a-4b36-814f-5306bc056dcb req-9e0f63eb-a504-4bfc-9a53-e7a92f0d29c7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0610974 Nov 16 03:23:34.679581 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4edd024-3d58-4452-826b-7efb5fcecaac req-a010e28b-bbd3-4cde-9e19-dcaa7a95aecd tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0284772 Nov 16 03:23:35.564204 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6791b125-0b95-43d9-8cf7-534c7fcdaf3f req-51d26a14-fd27-444d-b7a9-6b59dfa1f476 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:35.565849 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6791b125-0b95-43d9-8cf7-534c7fcdaf3f req-51d26a14-fd27-444d-b7a9-6b59dfa1f476 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0542474 Nov 16 03:23:35.617944 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6791b125-0b95-43d9-8cf7-534c7fcdaf3f req-794c45a7-d6fd-4ddc-afa0-fb06811e088f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440876 Nov 16 03:23:35.790282 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3ac98c2b-86cd-4d9a-bbb4-455c6e03f01f req-c7159624-6b7e-4245-86b3-e6f2d43cca5d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=05a570bf-47a2-4a56-ac98-b33b4d4ad565 HTTP/1.1" status: 200 len: 210 time: 0.0276117 Nov 16 03:23:35.861101 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:36.771151 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faacd6a-1754-42d0-9239-f7dbb858c7b3 req-d2baaa01-0ab0-4faa-8c9d-d3e96a3c659f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:36.773846 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3faacd6a-1754-42d0-9239-f7dbb858c7b3 req-d2baaa01-0ab0-4faa-8c9d-d3e96a3c659f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0613294 Nov 16 03:23:36.831295 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3faacd6a-1754-42d0-9239-f7dbb858c7b3 req-a341bd5d-1e9d-4565-b73f-722c9d44825c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508442 Nov 16 03:23:37.071261 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-3849670c-4dac-48e9-b4ac-b9b49de25bf2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1557299526&fields=id&tenant_id=f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 267 time: 0.0487516 Nov 16 03:23:37.192395 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-39500433-1263-4514-8a3a-e7f97dc85617 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:37.193944 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-39500433-1263-4514-8a3a-e7f97dc85617 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 812 time: 0.1151288 Nov 16 03:23:37.209890 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-77e4fecf-3d75-4be6-b0de-e102e4ba5d16 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/quotas/f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 375 time: 0.0100017 Nov 16 03:23:37.268338 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-17e198ac-7c0c-4472-8f9f-2cd857387353 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0520339 Nov 16 03:23:37.369412 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-0f2a296c-5670-4053-b29e-cd73f4d482b1 service neutron] 10.222.0.31 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886343 Nov 16 03:23:37.466904 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-3445cf4e-c516-4e70-ab8a-0a62e4417c15 service neutron] 10.222.0.31 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901804 Nov 16 03:23:37.799430 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-205b44bd-330f-40dc-92d5-2ca23bd2d5af req-45b9c21c-a849-494d-94ef-1018bfd12f69 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 210 time: 0.0471697 Nov 16 03:23:37.999525 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8431356-2d7e-43ff-bd3d-c9797d2677a0 req-43d56393-4cea-4485-b1da-ecf83d8072d0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:38.001307 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b8431356-2d7e-43ff-bd3d-c9797d2677a0 req-43d56393-4cea-4485-b1da-ecf83d8072d0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0592487 Nov 16 03:23:38.062093 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b8431356-2d7e-43ff-bd3d-c9797d2677a0 req-441be7dd-ec61-4cb3-807a-dcff4fedb1ed tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544362 Nov 16 03:23:38.933490 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a457e394-a483-470b-a983-67cac74bf127 req-0132ecdc-67ae-4203-91e4-b3a3d306e695 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 210 time: 0.0515819 Nov 16 03:23:38.988554 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-c408dac3-72c6-459a-bf4b-048196e20d72 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:38.990168 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-c408dac3-72c6-459a-bf4b-048196e20d72 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 812 time: 0.1345336 Nov 16 03:23:39.084391 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-96e55430-b457-458b-b09b-20362c83f6f2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 380 time: 0.0745144 Nov 16 03:23:39.115937 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'port': {'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'admin_state_up': True, 'tenant_id': 'f0e656658949487fb898565d34636908', 'security_groups': ['b3b2cefa-a732-4c2d-8879-25a8537d518a']}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:39.224939 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72939727-5196-45d1-9805-bbdbbeb4ecfc req-35caafa6-65fe-4d93-bb1b-bb604a4b7531 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:39.226545 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-72939727-5196-45d1-9805-bbdbbeb4ecfc req-35caafa6-65fe-4d93-bb1b-bb604a4b7531 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0756068 Nov 16 03:23:39.262514 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Made reservation on behalf of f0e656658949487fb898565d34636908 for: {'port': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:23:39.266731 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:39.290021 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-72939727-5196-45d1-9805-bbdbbeb4ecfc req-14b82502-d6df-4d32-869d-7bda86ec3d9c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571401 Nov 16 03:23:39.398081 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Allocated IP 172.20.0.5 (47ea8a48-7e03-48bf-883e-ab437cbcd3a0/5adb8701-919b-407f-b696-94dbe3d5e70a/e037ab2a-67a2-4571-bb58-938a1ea5e8c9) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:39.548760 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:39.589102 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:39.634751 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:39.637942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:39.642096 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:39.648735 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:39.711425 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:39.712060 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:39.736690 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-5aecff50-db71-45e7-898d-b6401432d146 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6269038 Nov 16 03:23:39.758282 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Request body: {'port': {'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:39.819531 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:39.898154 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-07047aca-b69f-4121-b18a-a146f6b3185d None None] Provisioning complete for port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:39.898807 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-07047aca-b69f-4121-b18a-a146f6b3185d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:39.940289 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-07047aca-b69f-4121-b18a-a146f6b3185d None None] Port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:23:40.058013 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3cbff8-254c-493c-9941-93fd0efee551 req-f60b25c6-844c-4b80-803b-70d7635364fe tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:40.059529 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ad3cbff8-254c-493c-9941-93fd0efee551 req-f60b25c6-844c-4b80-803b-70d7635364fe tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 931 time: 0.0521536 Nov 16 03:23:40.112642 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ad3cbff8-254c-493c-9941-93fd0efee551 req-7f84b2b6-9ee7-4f2a-aa9a-4210534d98f8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462906 Nov 16 03:23:40.134446 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e037ab2a-67a2-4571-bb58-938a1ea5e8c9 {{(pid=101898) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:23:40.143354 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:40.157253 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.provisioning_blocks [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Transition to ACTIVE for port object e037ab2a-67a2-4571-bb58-938a1ea5e8c9 will not be triggered until provisioned by entity L2. {{(pid=101898) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:23:40.161972 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:40.212284 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Pushing event updated for resources: {'Port': ['ID=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:40.299716 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Attempting to bind port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:40.300077 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Attempting to bind port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:40.300387 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Attempting to bind port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:40.305883 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:23:40.306204 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Attempting to bind port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:40.313599 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 23, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:40.313914 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Checking segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101898) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:40.314326 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Bound using segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} {{(pid=101898) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:40.314994 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.managers [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Bound port: e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}}] {{(pid=101898) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:40.315448 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:40.408078 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] For port e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host hv-cinder-81803, cleared binding levels {{(pid=101898) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:40.412285 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] For port e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101898) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:40.420680 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:40.440977 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61ef840-437b-405a-9236-d3f810d4f903 req-e08c11e6-1639-40d7-a9ba-f2582fc255ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:40.442652 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c61ef840-437b-405a-9236-d3f810d4f903 req-e08c11e6-1639-40d7-a9ba-f2582fc255ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0664330 Nov 16 03:23:40.456095 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:40.456685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:40.458516 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] 10.222.0.11 "PUT /v2.0/ports/e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 200 len: 1093 time: 0.7045536 Nov 16 03:23:40.461149 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:40.463439 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16bedb01-a47f-4892-b3c6-4a56e4da061f" -d '{"events": [{"name": "network-changed", "server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:40.498381 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-092e7a24-5f16-42e6-90ac-7554612bae4d service neutron] Pushing event updated for resources: {'Port': ['ID=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,revision_number=3']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:40.524292 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c61ef840-437b-405a-9236-d3f810d4f903 req-9af24b17-d9b4-42d0-b5f9-d763f62ad15e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711207 Nov 16 03:23:40.566030 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7eb5f78a-d53d-43f5-8026-c91057b7f3a9 x-openstack-request-id: req-7eb5f78a-d53d-43f5-8026-c91057b7f3a9 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:40.566321 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:40.566570 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-7eb5f78a-d53d-43f5-8026-c91057b7f3a9 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:40.566996 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'status': 'completed', 'code': 200} Nov 16 03:23:40.585821 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-8c605152-c434-496a-b526-8034e5b5efb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:40.587382 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-8c605152-c434-496a-b526-8034e5b5efb2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1096 time: 0.0526705 Nov 16 03:23:40.646467 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-fadd642b-fdc3-4bb6-ae93-67d635beda99 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 200 len: 217 time: 0.0358517 Nov 16 03:23:40.713658 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-8cc3f904-07f8-4f52-9ff8-1d7d26815935 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:40.715214 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-8cc3f904-07f8-4f52-9ff8-1d7d26815935 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0531702 Nov 16 03:23:40.770757 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-bd136f94-ec2e-4aae-9aaa-3c767e406d8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:40.772254 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-bd136f94-ec2e-4aae-9aaa-3c767e406d8c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451450 Nov 16 03:23:40.883103 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-cc2a95b3-5f86-4771-8ce1-ad6c6d1a5025 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1020875 Nov 16 03:23:40.987807 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-1932f066-85f2-4fb3-aa1f-e5b3294eaf8b req-139721d5-0af7-4dc2-9773-9128af3bbdfb service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0935929 Nov 16 03:23:41.129013 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-d08e7717-7158-463c-9b33-646b3c966ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:41.130563 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-d08e7717-7158-463c-9b33-646b3c966ac7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1096 time: 0.0450761 Nov 16 03:23:41.235730 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612e1f52-dd6c-4126-8527-46ed7e62d922 req-41aa3b68-949d-4dd4-a0c2-874610502b26 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:41.237273 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-612e1f52-dd6c-4126-8527-46ed7e62d922 req-41aa3b68-949d-4dd4-a0c2-874610502b26 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 943 time: 0.0498796 Nov 16 03:23:41.241623 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-4969280e-2e4b-42ac-9937-119713a1c6c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:41.246049 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-4969280e-2e4b-42ac-9937-119713a1c6c0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.1039879 Nov 16 03:23:41.296282 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-bd598a65-7569-45d7-98ff-9e5f2c802dae service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 200 len: 217 time: 0.0406985 Nov 16 03:23:41.296617 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-612e1f52-dd6c-4126-8527-46ed7e62d922 req-d2790469-7a0c-40a7-a7a0-dfa7af0edaec tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516648 Nov 16 03:23:41.355556 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-515482b9-c82c-4af4-ad96-5c4392951290 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:41.357167 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-515482b9-c82c-4af4-ad96-5c4392951290 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0529492 Nov 16 03:23:41.412791 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-69caee02-735b-4247-8668-889cf368c365 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:41.414484 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-69caee02-735b-4247-8668-889cf368c365 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0486119 Nov 16 03:23:41.511963 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-1463da7e-4b00-4e61-b6c1-b345b8ec878d service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870485 Nov 16 03:23:41.615161 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-16bedb01-a47f-4892-b3c6-4a56e4da061f req-50f39795-2745-44ac-8fcf-1ee89d70aa6e service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0952141 Nov 16 03:23:41.662595 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0574ae0-9b93-4046-a217-5209295dc048 req-ae31dc09-1e32-467f-8a4c-e7ad54655f9a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:41.664162 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0574ae0-9b93-4046-a217-5209295dc048 req-ae31dc09-1e32-467f-8a4c-e7ad54655f9a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0553763 Nov 16 03:23:41.722063 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0574ae0-9b93-4046-a217-5209295dc048 req-507dbe6c-efcb-4ce5-8b64-d5ea3dbf0925 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508027 Nov 16 03:23:42.418899 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906d4ffc-e802-4e80-868c-3fadb3880a07 req-eb9bb056-e33f-46b0-94b1-2b54fb86feec tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:42.420464 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-906d4ffc-e802-4e80-868c-3fadb3880a07 req-eb9bb056-e33f-46b0-94b1-2b54fb86feec tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 943 time: 0.0514269 Nov 16 03:23:42.474755 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-906d4ffc-e802-4e80-868c-3fadb3880a07 req-593efcd0-f72b-4e76-8324-04be6ce7c386 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476682 Nov 16 03:23:42.852600 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25af7496-8794-4288-a4ae-89c2954e9b6e req-c9113992-843e-4dbe-8c1f-e1ef58981a11 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:42.854202 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-25af7496-8794-4288-a4ae-89c2954e9b6e req-c9113992-843e-4dbe-8c1f-e1ef58981a11 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 944 time: 0.0547471 Nov 16 03:23:42.907682 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-25af7496-8794-4288-a4ae-89c2954e9b6e req-51686b13-f97c-4efb-bd57-b8d63f7cb87d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470493 Nov 16 03:23:43.234058 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-f0486152-eb67-494e-9fc7-ac815a34fa02 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1683105470&fields=id&tenant_id=76754ec1f4b143ceabbcb17af1aa513b HTTP/1.1" status: 200 len: 267 time: 0.0704777 Nov 16 03:23:43.263421 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-2c1e4fe1-8dd3-46b3-a032-6da2b5343b3b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1457425326&fields=id&tenant_id=2ea0808579e44cdcaeba4109bc12863b HTTP/1.1" status: 200 len: 267 time: 0.0821686 Nov 16 03:23:43.337369 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:23:43.360931 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-d0070772-1fc3-45fd-ab70-c87922ec40e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:43.362695 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-d0070772-1fc3-45fd-ab70-c87922ec40e0 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 985 time: 0.1144538 Nov 16 03:23:43.380319 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Request body: {'port': {'security_groups': ['baadeb48-7237-4752-a8bf-62e69b7ab85b']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:43.439913 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:43.442101 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-980617fa-3fa3-4a7d-b296-6c6cc45b2116 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:43.443630 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-980617fa-3fa3-4a7d-b296-6c6cc45b2116 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 808 time: 0.1662734 Nov 16 03:23:43.453192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'port_id': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'mac_address': 'fa:16:3e:c6:a7:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:23:43.479668 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:43.482429 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-120b3134-e14e-4dfd-abef-f15f7ce26463 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/quotas/2ea0808579e44cdcaeba4109bc12863b HTTP/1.1" status: 200 len: 375 time: 0.0207372 Nov 16 03:23:43.494234 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:43.515489 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c8dba4d7-4e08-40c8-a119-0e68144a64b1 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:23:43.539194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:43.545905 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:43.590817 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-a9226e47-0120-44bd-b35d-da6b221eb726 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0997028 Nov 16 03:23:43.597048 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=9']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:43.761925 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-08602b06-b81e-435a-8c7d-100b668b0c60 service neutron] 10.222.0.31 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1553833 Nov 16 03:23:43.769626 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:43.854588 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['c8dba4d7-4e08-40c8-a119-0e68144a64b1'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:23:44.095978 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.102863 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.170016 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:44.170729 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.172161 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bd8dbafc-7b64-47ac-8116-751bc0595c95 req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "PUT /v2.0/ports/373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 943 time: 0.8004146 Nov 16 03:23:44.172861 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:44.178490 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db741835-d1ee-4a58-9a51-8d72a750adde" -d '{"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:44.179338 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-3db3c9fd-c7db-48e6-aee9-0b1a6d934364 service neutron] 10.222.0.31 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4062135 Nov 16 03:23:44.180251 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49504) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:44.195753 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8116a841-aed1-4ba0-b547-10239c714551 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event updated for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=7']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:44.285976 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2360cd8c-25c1-4bc8-acf9-5239ae3d7df2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.321736 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2360cd8c-25c1-4bc8-acf9-5239ae3d7df2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.324035 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f920ebad-5b25-4bf2-b7b0-c83b53e20027 req-e5143346-5f23-4efb-a69f-a28cd806552d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:44.326083 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f920ebad-5b25-4bf2-b7b0-c83b53e20027 req-e5143346-5f23-4efb-a69f-a28cd806552d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 943 time: 0.0685585 Nov 16 03:23:44.344838 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['373f70dc-3a64-458a-a38c-adab3f4f3275'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:23:44.402627 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8076913b-f35b-4dc6-8cc7-a70ce48d7929 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.403972 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2360cd8c-25c1-4bc8-acf9-5239ae3d7df2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.406819 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2360cd8c-25c1-4bc8-acf9-5239ae3d7df2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.410982 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2360cd8c-25c1-4bc8-acf9-5239ae3d7df2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "DELETE /v2.0/security-groups/779f874f-c312-438b-8e31-979b354c2f48 HTTP/1.1" status: 204 len: 168 time: 0.2276955 Nov 16 03:23:44.414335 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49512) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:44.431507 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2360cd8c-25c1-4bc8-acf9-5239ae3d7df2 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=779f874f-c312-438b-8e31-979b354c2f48,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:44.448259 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['373f70dc-3a64-458a-a38c-adab3f4f3275'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:23:44.470573 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f920ebad-5b25-4bf2-b7b0-c83b53e20027 req-e73cc377-49a2-4f15-abf9-75cdd8cfacc8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1386008 Nov 16 03:23:44.546833 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-4e75e9f0-791d-4c97-af25-008841add60f None None] Provisioning complete for port 373f70dc-3a64-458a-a38c-adab3f4f3275 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:44.547370 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4e75e9f0-791d-4c97-af25-008841add60f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.617716 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d4577cb-8bb8-4c55-9b86-fd24b957552b req-713b3625-4534-4640-b75d-4dae92f4bd8f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:44.629746 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d4577cb-8bb8-4c55-9b86-fd24b957552b req-713b3625-4534-4640-b75d-4dae92f4bd8f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 945 time: 0.0740881 Nov 16 03:23:44.691196 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d4577cb-8bb8-4c55-9b86-fd24b957552b req-0ae4a829-c203-4989-91a0-34a57a8dd811 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599914 Nov 16 03:23:44.693586 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Deleting port a26e0aa3-8ac4-41b2-afd9-c41c379bb86a {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:23:44.693853 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.787867 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3a46314-cc50-415c-b168-6faba447ab59 x-openstack-request-id: req-f3a46314-cc50-415c-b168-6faba447ab59 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:44.788293 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:44.788805 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f3a46314-cc50-415c-b168-6faba447ab59 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:44.789301 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'status': 'completed', 'code': 200} Nov 16 03:23:44.814543 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-192737e5-1ef8-49d3-b9e0-a4f209b1fe2a req-79064bd4-a7b0-46e7-9007-fb9b3307a3ac tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 210 time: 0.0462570 Nov 16 03:23:44.829024 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.832344 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:44.860462 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Calling delete_port for a26e0aa3-8ac4-41b2-afd9-c41c379bb86a owned by network:floatingip {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:23:44.958511 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db741835-d1ee-4a58-9a51-8d72a750adde req-1a26d5d8-8a21-41d1-9a2a-f8c51de967d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:44.960518 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-1a26d5d8-8a21-41d1-9a2a-f8c51de967d7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1099 time: 0.1177707 Nov 16 03:23:45.120300 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db741835-d1ee-4a58-9a51-8d72a750adde req-6086918d-deff-4ef1-82f8-e55fec4cd1ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:45.121821 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-6086918d-deff-4ef1-82f8-e55fec4cd1ae service neutron] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 915 time: 0.1478093 Nov 16 03:23:45.226190 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-94d2174a-6843-4e40-92d5-ad3e679760c6 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 1002 time: 0.0910926 Nov 16 03:23:45.227223 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:45.259258 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event deleted for resources: {'Port': ['ID=a26e0aa3-8ac4-41b2-afd9-c41c379bb86a,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:45.349795 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:45.351883 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db741835-d1ee-4a58-9a51-8d72a750adde req-8bc2c069-1074-4f64-9dd0-ab88a42f2f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:45.353593 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-8bc2c069-1074-4f64-9dd0-ab88a42f2f93 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.0921657 Nov 16 03:23:45.373527 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks [] for floatingip, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:45.373875 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.l3_db [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Floating IP be525ef3-de7f-4378-8b15-8328b430b43a disassociated (deleted). External IP: 172.27.1.100, port: 373f70dc-3a64-458a-a38c-adab3f4f3275. Nov 16 03:23:45.409108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port c8dba4d7-4e08-40c8-a119-0e68144a64b1 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:45.409492 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:45.476999 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db741835-d1ee-4a58-9a51-8d72a750adde req-f58fdab8-a0ff-4f00-b1a4-cdc0e90cb150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:45.478597 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-f58fdab8-a0ff-4f00-b1a4-cdc0e90cb150 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1162417 Nov 16 03:23:45.504194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:45.545790 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:45.550013 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-faa24e5a-70ef-415a-9188-71ad2051d4e8" -d '{"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-plugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:45.573305 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:45.583295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:45.621502 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea9e6806-51c8-4903-b819-7924931e6682 req-8329afd5-a4c4-4f7a-826d-b34eb6d8dad3 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:45.622224 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5b46dc2-4037-44aa-8505-cfddfa623fa1 x-openstack-request-id: req-f5b46dc2-4037-44aa-8505-cfddfa623fa1 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:45.622579 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-plugged", "status": "completed", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:45.623007 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f5b46dc2-4037-44aa-8505-cfddfa623fa1 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:45.623511 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'code': 200} Nov 16 03:23:45.631578 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ea9e6806-51c8-4903-b819-7924931e6682 req-8329afd5-a4c4-4f7a-826d-b34eb6d8dad3 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 943 time: 0.0903621 Nov 16 03:23:45.659208 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=10']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:45.684417 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-c757e63e-eb52-4fd4-bb74-64d2cb77f615 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1968851 Nov 16 03:23:45.710215 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ea9e6806-51c8-4903-b819-7924931e6682 req-0508245a-f9c0-412b-8a89-7c85657e199b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774071 Nov 16 03:23:45.774835 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:23:45.940989 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f39c571c-21e3-4949-9215-d5257be12a84 req-f6abc021-dce7-4c35-a566-c9e1fbe73d9f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 210 time: 0.0427918 Nov 16 03:23:45.954106 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-2a1b4275-4e0d-4a04-a881-73b16f94c8ed tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:45.955701 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-2a1b4275-4e0d-4a04-a881-73b16f94c8ed tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 808 time: 0.1950922 Nov 16 03:23:45.974486 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61443194-e570-4a9c-81c6-5a75d919f44e req-f870859b-9aa1-4418-8fe0-ce77072201a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:45.976139 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-61443194-e570-4a9c-81c6-5a75d919f44e req-f870859b-9aa1-4418-8fe0-ce77072201a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.1537542 Nov 16 03:23:46.083093 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-61443194-e570-4a9c-81c6-5a75d919f44e req-7b8cf5bd-71e6-4af7-bae8-83b8271d315c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0934708 Nov 16 03:23:46.092146 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-c01fff70-1352-45bb-ad8a-21b6980e1f4a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2ea0808579e44cdcaeba4109bc12863b HTTP/1.1" status: 200 len: 380 time: 0.1110356 Nov 16 03:23:46.104146 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'port': {'device_id': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'admin_state_up': True, 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'security_groups': ['e87cca3f-4826-407f-8ec0-d093b4170bee']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:46.206534 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-db741835-d1ee-4a58-9a51-8d72a750adde req-4c502bb1-0375-4e1f-923b-3e0b86b8097f service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5132301 Nov 16 03:23:46.250898 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:46.260685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe17564-41d7-42bd-b387-3743d8670afc req-452a45ad-efa2-4d02-8552-ed2045bbd51f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:46.261457 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:46.262493 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dfe17564-41d7-42bd-b387-3743d8670afc req-452a45ad-efa2-4d02-8552-ed2045bbd51f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1100 time: 0.0678048 Nov 16 03:23:46.281367 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Made reservation on behalf of 2ea0808579e44cdcaeba4109bc12863b for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:23:46.281367 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:46.286642 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] Sync routers for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:46.298350 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-375dbc15-ee50-40b5-bd43-e4c132332f5c tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "DELETE /v2.0/floatingips/be525ef3-de7f-4378-8b15-8328b430b43a HTTP/1.1" status: 204 len: 168 time: 1.8792796 Nov 16 03:23:46.298350 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101898) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:46.300157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}22935d708c24e405edd882086fd825797beda6b65b30f1836a26b0c0de92147f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c" -d '{"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101898) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:46.335103 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:46.335945 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:46.375024 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c12cffe-c1ed-414a-ab6a-00fd6f7846a5 x-openstack-request-id: req-7c12cffe-c1ed-414a-ab6a-00fd6f7846a5 {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:46.375350 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "status": "completed", "code": 200}]} {{(pid=101898) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:46.375601 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-7c12cffe-c1ed-414a-ab6a-00fd6f7846a5 {{(pid=101898) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:46.376005 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'status': 'completed', 'code': 200} Nov 16 03:23:46.383583 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dfe17564-41d7-42bd-b387-3743d8670afc req-6a1bc5a3-b2de-4162-925f-e7cf65a1adee service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1136923 Nov 16 03:23:46.460260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Allocated IP 172.20.0.14 (55d54831-cf2b-4880-8018-9fcb1b176026/23f46016-2284-401d-92a1-617f967a864f/338936ea-fa25-4065-9970-6d7171659768) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:46.499406 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:46.644882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:46.679263 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:46.753859 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:46.758882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Network 55d54831-cf2b-4880-8018-9fcb1b176026 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:46.772235 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:46.778819 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:46.783583 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:46.790105 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] Checking router: 0f03a58b-d978-4d06-8b7c-905f27fd0d8a for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:46.800979 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:46.801862 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:46.810969 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-2b2c1073-76e2-4b51-b2c1-6c11548b497b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:46.812552 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-2b2c1073-76e2-4b51-b2c1-6c11548b497b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 1099 time: 0.1014407 Nov 16 03:23:46.936107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:46.936919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:46.947533 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:47.008108 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-106b6135-def0-42e2-9d1c-87f0d4cde7d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:47.009981 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-106b6135-def0-42e2-9d1c-87f0d4cde7d0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 200 len: 915 time: 0.1869032 Nov 16 03:23:47.016487 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-f309c415-18f6-4ae1-9f19-22c3af79173f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9163623 Nov 16 03:23:47.030906 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9079dfc-e697-4d23-b835-2fa68712ece1 req-ebf1bc43-071e-4b4f-85e5-5d9c1a1462b8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:47.039031 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b9079dfc-e697-4d23-b835-2fa68712ece1 req-ebf1bc43-071e-4b4f-85e5-5d9c1a1462b8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 943 time: 0.1522870 Nov 16 03:23:47.058524 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Request body: {'port': {'device_id': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:47.146324 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-665ab04c-3b57-4789-9d11-6f7df2938807 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 200 len: 217 time: 0.0983727 Nov 16 03:23:47.206559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:47.239338 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b181b575-c879-4071-ab54-d1c9c38ffacc None None] The sync data for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi is: [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:11Z', 'revision_number': 4, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '18838d54-2a88-461c-8662-98ba7ad9f972', 'name': '', 'network_id': '3d7e4ea5-05db-41ca-8436-96b38d0ef4ef', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'mac_address': 'fa:16:3e:f8:36:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:09Z', 'updated_at': '2021-11-16T03:20:16Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'subnets': [{'id': 'e24021b9-c30d-4d4e-b10a-332e32fda211', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:47.249936 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b9079dfc-e697-4d23-b835-2fa68712ece1 req-6c92020e-7dcc-4dd1-9512-dff4f604d48b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2099440 Nov 16 03:23:47.251554 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8f51ab82-2817-41a2-8b86-dee8bfa2f5b0 None None] Provisioning complete for port 338936ea-fa25-4065-9970-6d7171659768 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:47.252156 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8f51ab82-2817-41a2-8b86-dee8bfa2f5b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:47.263495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:47.274530 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab45a06-ac9f-4b1a-b35a-579d45f4946d req-b131ce84-cb31-49df-a55a-49dca56baa83 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:47.285988 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5ab45a06-ac9f-4b1a-b35a-579d45f4946d req-b131ce84-cb31-49df-a55a-49dca56baa83 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 932 time: 0.2243094 Nov 16 03:23:47.291194 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-b6aaaaee-606b-4b86-b95d-17372f1e3ec2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:47.292712 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-b6aaaaee-606b-4b86-b95d-17372f1e3ec2 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 200 len: 853 time: 0.1285741 Nov 16 03:23:47.440969 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5ab45a06-ac9f-4b1a-b35a-579d45f4946d req-5b630622-0552-486e-9c7b-8e4b0ffadab1 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1408229 Nov 16 03:23:47.447013 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-f2ba22f6-5eed-4fb7-832e-7accb7536dae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:47.448592 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-f2ba22f6-5eed-4fb7-832e-7accb7536dae service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1411729 Nov 16 03:23:47.481021 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8f51ab82-2817-41a2-8b86-dee8bfa2f5b0 None None] Port 338936ea-fa25-4065-9970-6d7171659768 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:23:47.668835 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f9198b3-7c81-47c3-a8f2-d95fea15a73a None None] New status for floating IP be525ef3-de7f-4378-8b15-8328b430b43a: DOWN {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:23:47.709568 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ddca5b-ee65-49c0-8025-f4ca727e1b6b req-6643c1ac-408b-448c-a7c4-6d3a8433ac56 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:47.712698 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-60ddca5b-ee65-49c0-8025-f4ca727e1b6b req-6643c1ac-408b-448c-a7c4-6d3a8433ac56 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.2166598 Nov 16 03:23:47.813264 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-7b222b56-758e-4480-857e-bcde6e13c5e4 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3184729 Nov 16 03:23:47.960130 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-60ddca5b-ee65-49c0-8025-f4ca727e1b6b req-73344ef7-3b7e-4263-8b57-0bcf0c7190d2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2355397 Nov 16 03:23:48.032840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 338936ea-fa25-4065-9970-6d7171659768 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:23:48.042941 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d8275a05-d1a6-476c-8c1d-a1370d6ba09c req-cce3365f-8cf4-4bdd-8884-9a79cfea84b5 service neutron] 10.222.0.11 "GET /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2002432 Nov 16 03:23:48.045107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:48.060292 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Transition to ACTIVE for port object 338936ea-fa25-4065-9970-6d7171659768 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:23:48.064678 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:48.174480 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:48.221001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Attempting to bind port 338936ea-fa25-4065-9970-6d7171659768 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:23:48.221338 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Attempting to bind port 338936ea-fa25-4065-9970-6d7171659768 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:23:48.221693 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Attempting to bind port 338936ea-fa25-4065-9970-6d7171659768 on network 55d54831-cf2b-4880-8018-9fcb1b176026 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:48.229088 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Port 338936ea-fa25-4065-9970-6d7171659768 on network 55d54831-cf2b-4880-8018-9fcb1b176026 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:23:48.229414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Attempting to bind port 338936ea-fa25-4065-9970-6d7171659768 on network 55d54831-cf2b-4880-8018-9fcb1b176026 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:23:48.236265 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 23, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:23:48.236593 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Checking segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:23:48.236976 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Bound using segment: {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:23:48.237484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Bound port: 338936ea-fa25-4065-9970-6d7171659768, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13b9e88b-efa5-4d1d-81ea-971df0ce2a81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 349, 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:23:48.237850 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:48.330332 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:23:48.336208 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:23:48.341774 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:48.431628 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:48.432267 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:48.433707 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] 10.222.0.11 "PUT /v2.0/ports/338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 1094 time: 1.3799295 Nov 16 03:23:48.434167 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:48.436584 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4" -d '{"events": [{"name": "network-changed", "server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:48.453754 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-9857bec2-a053-4ebd-89fe-ebe671fd8e97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:48.479670 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf66a6e7-22d1-4f6e-91d7-632d48ac59a7 service neutron] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:48.485586 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f999e356-f8fd-43ad-bbe1-ee74485e6fae x-openstack-request-id: req-f999e356-f8fd-43ad-bbe1-ee74485e6fae {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:48.485937 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "tag": "338936ea-fa25-4065-9970-6d7171659768", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:48.486127 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f999e356-f8fd-43ad-bbe1-ee74485e6fae {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:48.486604 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'status': 'completed', 'code': 200} Nov 16 03:23:48.500864 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b351b56-7fc9-4cbb-99f9-a3a25c72de4a req-4870fbcd-e496-4572-b6ec-8431b357f803 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:48.510306 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b351b56-7fc9-4cbb-99f9-a3a25c72de4a req-4870fbcd-e496-4572-b6ec-8431b357f803 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 943 time: 0.1557672 Nov 16 03:23:48.624943 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bb350e17-8d6e-4900-9b7f-ea2d39432d51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:48.626498 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-bb350e17-8d6e-4900-9b7f-ea2d39432d51 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1097 time: 0.1149611 Nov 16 03:23:48.655754 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b351b56-7fc9-4cbb-99f9-a3a25c72de4a req-b568f474-870f-4db9-921a-53121260a112 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1080494 Nov 16 03:23:48.665794 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de44ab47-44ef-48ad-be9b-f4ee63b68611 req-f6f8327c-43c8-4c59-8783-0e4943b2d20b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:48.667353 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de44ab47-44ef-48ad-be9b-f4ee63b68611 req-f6f8327c-43c8-4c59-8783-0e4943b2d20b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.1123714 Nov 16 03:23:48.701039 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-e535d3d1-2bd2-47ba-904a-0153723c6349 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 217 time: 0.0576429 Nov 16 03:23:48.784120 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-de44ab47-44ef-48ad-be9b-f4ee63b68611 req-982d92f7-b2eb-4895-865b-16c92d095c84 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0902560 Nov 16 03:23:48.785892 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-1e203546-f5f0-4ab1-8c5a-8829f71f85f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:48.787380 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-1e203546-f5f0-4ab1-8c5a-8829f71f85f2 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.0744963 Nov 16 03:23:48.849201 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-a1be9aaf-88cf-4aa4-bc52-94486a08f0ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:48.850799 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-a1be9aaf-88cf-4aa4-bc52-94486a08f0ec service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0547340 Nov 16 03:23:48.964475 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-e5a5feba-7efd-4e6e-86e4-fe17ea353963 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1051085 Nov 16 03:23:49.096093 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e56dded1-48df-463a-8b79-a7a0ad81ecab req-7136e75b-2ea0-4e0e-bdb3-d4f7df37c476 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1231987 Nov 16 03:23:49.143771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6056e49e-539c-4dc4-9015-eab84bd2227c req-d927374f-06ef-4d4d-b06e-9d86b8a5ab99 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:49.145381 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6056e49e-539c-4dc4-9015-eab84bd2227c req-d927374f-06ef-4d4d-b06e-9d86b8a5ab99 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.0633712 Nov 16 03:23:49.237575 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6056e49e-539c-4dc4-9015-eab84bd2227c req-d0040fc3-0042-40d0-95bc-6b74fabc7bf6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0855963 Nov 16 03:23:49.282841 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-df3ad4f0-9cee-4d56-838e-e073bbb5ff05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:49.285353 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-df3ad4f0-9cee-4d56-838e-e073bbb5ff05 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1097 time: 0.0884602 Nov 16 03:23:49.367021 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device e037ab2a-67a2-4571-bb58-938a1ea5e8c9 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:23:49.388694 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-f5d43e8d-4a0a-4ced-b162-c71a8202781f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:49.390260 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-f5d43e8d-4a0a-4ced-b162-c71a8202781f service neutron] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 909 time: 0.0971563 Nov 16 03:23:49.450868 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-195f6f3e-7317-4715-8ef9-6422d2bda07b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 217 time: 0.0523384 Nov 16 03:23:49.484544 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:49.500591 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:23:49.504806 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-1abf1c3e-70fc-4be3-a3c0-70011dad5c4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:49.506345 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-1abf1c3e-70fc-4be3-a3c0-70011dad5c4b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.0484593 Nov 16 03:23:49.549847 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:49.566637 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-c5f2f2a5-87a4-40d7-8d20-7beb45412981 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:49.567015 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e037ab2a-67a2-4571-bb58-938a1ea5e8c9 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:23:49.568218 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-c5f2f2a5-87a4-40d7-8d20-7beb45412981 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0521805 Nov 16 03:23:49.590304 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:49.596559 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:49.649776 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:49.674270 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-8a26ecb9-8a14-4180-a7b0-440aa134cc8c service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0972407 Nov 16 03:23:49.795012 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:49.826897 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9ad3b187-4dce-4653-b8e3-e2f207a18fe4 req-0b75f9f3-552c-41d7-9baf-8e5544d72b53 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1439209 Nov 16 03:23:49.835198 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75611c6a-ad87-47f0-b3cd-fa5f84e36916 req-aa72f490-5688-4803-aac2-d776f81fa77c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:49.836694 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-75611c6a-ad87-47f0-b3cd-fa5f84e36916 req-aa72f490-5688-4803-aac2-d776f81fa77c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 944 time: 0.0944877 Nov 16 03:23:49.898176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['e037ab2a-67a2-4571-bb58-938a1ea5e8c9'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:23:50.137810 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:23:50.192468 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-75611c6a-ad87-47f0-b3cd-fa5f84e36916 req-773445bd-610e-4ba1-bcad-ef9bb3e97afa tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3482180 Nov 16 03:23:50.211621 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3566a2b-617e-421d-958d-8f20269b7dda req-c37a547b-5bb1-437e-9269-0bf27daa0716 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:50.213222 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3566a2b-617e-421d-958d-8f20269b7dda req-c37a547b-5bb1-437e-9269-0bf27daa0716 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0825942 Nov 16 03:23:50.276455 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f3566a2b-617e-421d-958d-8f20269b7dda req-dfd2d33f-1b44-47be-ba50-3f2705288933 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562880 Nov 16 03:23:50.448001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4019bcfd-9904-42e4-b9cb-4baa93d6247b req-f3a14b9d-4491-433a-84fb-214ed870df50 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:50.449614 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4019bcfd-9904-42e4-b9cb-4baa93d6247b req-f3a14b9d-4491-433a-84fb-214ed870df50 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0521476 Nov 16 03:23:50.508687 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4019bcfd-9904-42e4-b9cb-4baa93d6247b req-b1b40d18-bdd8-4203-ba6a-3bf9de27b9ae tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509057 Nov 16 03:23:51.336721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ad1adc0-ec6f-4b13-976f-52067b000a22 req-43454085-0c2c-4603-86f3-dd195560b043 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:51.339141 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1ad1adc0-ec6f-4b13-976f-52067b000a22 req-43454085-0c2c-4603-86f3-dd195560b043 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 944 time: 0.0669334 Nov 16 03:23:51.383097 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device e037ab2a-67a2-4571-bb58-938a1ea5e8c9 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:51.456367 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1ad1adc0-ec6f-4b13-976f-52067b000a22 req-98ca3655-0b85-4480-a29f-230cfb75c326 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1096857 Nov 16 03:23:51.462201 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:23:51.465648 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd0b8d3-1b31-4dd9-b4b9-81b0a5dae8ac req-350d7362-6d12-4776-ac30-a87764dd3b2f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:51.467741 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-afd0b8d3-1b31-4dd9-b4b9-81b0a5dae8ac req-350d7362-6d12-4776-ac30-a87764dd3b2f tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0994852 Nov 16 03:23:51.470452 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:51.470452 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:51.534832 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:51.559836 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-afd0b8d3-1b31-4dd9-b4b9-81b0a5dae8ac req-643f9d81-af53-41c1-9425-2508278eb030 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782287 Nov 16 03:23:51.617420 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:51.621166 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:51.649237 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:51.651649 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6283abf0-50e8-4e7b-9ed7-f64945b531ad" -d '{"events": [{"server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "name": "network-vif-plugged", "status": "completed", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:51.668037 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:51.673659 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcc1109-8771-4857-9f3e-ac87bb722c73 req-7187f856-3817-476b-8968-6bd2d5b8b836 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:51.674802 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:51.676163 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6bcc1109-8771-4857-9f3e-ac87bb722c73 req-7187f856-3817-476b-8968-6bd2d5b8b836 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0752861 Nov 16 03:23:51.726402 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8996a3f-635e-4a05-8f66-ea83fdc5d698 x-openstack-request-id: req-b8996a3f-635e-4a05-8f66-ea83fdc5d698 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:51.726702 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "name": "network-vif-plugged", "status": "completed", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:51.726949 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b8996a3f-635e-4a05-8f66-ea83fdc5d698 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:51.727439 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'code': 200} Nov 16 03:23:51.748647 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:51.749981 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6bcc1109-8771-4857-9f3e-ac87bb722c73 req-274a3cce-67d1-488c-a24c-593c94cc8542 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594406 Nov 16 03:23:52.084159 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b86152a-e0ad-41c5-a558-c0dc57df4a95 req-0509ff57-9b0e-416f-8560-f66382ec14c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:52.085867 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b86152a-e0ad-41c5-a558-c0dc57df4a95 req-0509ff57-9b0e-416f-8560-f66382ec14c2 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1098 time: 0.0461442 Nov 16 03:23:52.143077 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5b86152a-e0ad-41c5-a558-c0dc57df4a95 req-3ee2cae7-c1fe-4ecf-a528-c6301e86ca1e service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465362 Nov 16 03:23:52.554657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-0c2122d5-ebff-472b-ac68-438833d61018 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:52.556422 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-0c2122d5-ebff-472b-ac68-438833d61018 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.11 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.0591073 Nov 16 03:23:52.717402 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84bdc40-7eb9-45dc-8b03-8e5a7b6f4962 req-bc5a092b-fb7e-4eec-9944-09ef3af50d65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:52.719241 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c84bdc40-7eb9-45dc-8b03-8e5a7b6f4962 req-bc5a092b-fb7e-4eec-9944-09ef3af50d65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 945 time: 0.1275096 Nov 16 03:23:52.769814 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b7c462-5822-4bff-a4cf-15fb5cca8ed7 req-bd98fb4d-f288-451e-84cb-783d64453731 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:52.771350 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-37b7c462-5822-4bff-a4cf-15fb5cca8ed7 req-bd98fb4d-f288-451e-84cb-783d64453731 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.1100211 Nov 16 03:23:52.799332 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Deleting port 373f70dc-3a64-458a-a38c-adab3f4f3275 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:23:52.799666 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:52.872554 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c84bdc40-7eb9-45dc-8b03-8e5a7b6f4962 req-d86c15da-3f96-486d-8634-ec754f358c1e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1451972 Nov 16 03:23:52.924899 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-37b7c462-5822-4bff-a4cf-15fb5cca8ed7 req-5ff64bb0-44ab-4426-98b8-6776d5deae33 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1377141 Nov 16 03:23:52.967612 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] For port 373f70dc-3a64-458a-a38c-adab3f4f3275, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=373f70dc-3a64-458a-a38c-adab3f4f3275,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:52.968212 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:53.035190 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Calling delete_port for 373f70dc-3a64-458a-a38c-adab3f4f3275 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:23:53.099251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12eddeb3-08f6-492e-b404-ad3e068d7c8e req-a095fcb9-d642-4227-81ee-e23773ae9e44 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:53.100962 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-12eddeb3-08f6-492e-b404-ad3e068d7c8e req-a095fcb9-d642-4227-81ee-e23773ae9e44 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/ports?device_id=255d930d-c9d8-4140-9932-c123fb2f2ca7 HTTP/1.1" status: 200 len: 946 time: 0.1373835 Nov 16 03:23:53.202771 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-12eddeb3-08f6-492e-b404-ad3e068d7c8e req-363d2a9c-7dc8-49ec-b325-814c888d7671 tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.31 "GET /v2.0/security-groups?id=baadeb48-7237-4752-a8bf-62e69b7ab85b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950661 Nov 16 03:23:53.300183 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:53.332328 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Pushing event deleted for resources: {'Port': ['ID=373f70dc-3a64-458a-a38c-adab3f4f3275,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:53.343908 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['373f70dc-3a64-458a-a38c-adab3f4f3275'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:23:53.389185 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] No DVR routers for this DVR port 373f70dc-3a64-458a-a38c-adab3f4f3275 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:23:53.392291 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:53.395963 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cedba3ab-bf07-4cfa-90fe-4ceab4efd06a req-037301e5-4a50-498a-8e5e-e57559198f0a tempest-TestMinimumBasicScenario-2049812125 tempest-TestMinimumBasicScenario-2049812125-project] 10.222.0.11 "DELETE /v2.0/ports/373f70dc-3a64-458a-a38c-adab3f4f3275 HTTP/1.1" status: 204 len: 173 time: 0.8314111 Nov 16 03:23:53.396457 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'name': 'network-vif-deleted', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:53.399028 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1781fd5a-efd1-4da5-9720-584da977a922" -d '{"events": [{"server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "name": "network-vif-deleted", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:53.444310 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b14f3bf-1f7d-4520-9cdf-53c3b37b46a9 x-openstack-request-id: req-0b14f3bf-1f7d-4520-9cdf-53c3b37b46a9 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:53.444623 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "255d930d-c9d8-4140-9932-c123fb2f2ca7", "name": "network-vif-deleted", "tag": "373f70dc-3a64-458a-a38c-adab3f4f3275", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:53.444877 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-0b14f3bf-1f7d-4520-9cdf-53c3b37b46a9 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:53.445292 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '255d930d-c9d8-4140-9932-c123fb2f2ca7', 'name': 'network-vif-deleted', 'tag': '373f70dc-3a64-458a-a38c-adab3f4f3275', 'status': 'completed', 'code': 200} Nov 16 03:23:54.039201 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47165409-3016-47be-8bb4-c2dc33365f79 req-98240120-c5bc-4883-8ae3-fea013bb895e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:54.040825 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-47165409-3016-47be-8bb4-c2dc33365f79 req-98240120-c5bc-4883-8ae3-fea013bb895e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 945 time: 0.0751576 Nov 16 03:23:54.127250 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-47165409-3016-47be-8bb4-c2dc33365f79 req-e16cf1ab-982d-429c-abe8-ef0b6960d8c9 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648944 Nov 16 03:23:54.135218 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94265313-e0af-48bb-abf1-801a489a1a0e req-95f519f4-9847-400c-9354-9374e3c2ff97 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:54.137172 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-94265313-e0af-48bb-abf1-801a489a1a0e req-95f519f4-9847-400c-9354-9374e3c2ff97 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.1169817 Nov 16 03:23:54.228217 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-94265313-e0af-48bb-abf1-801a489a1a0e req-0a51e3ef-e53a-4bcf-adec-084a9480520c tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802405 Nov 16 03:23:54.278495 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c6dc7b-1f2c-477c-a4bc-92dd30f5afb1 req-145955a3-ae67-414e-b453-8e4a542bd4a0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:54.281389 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7c6dc7b-1f2c-477c-a4bc-92dd30f5afb1 req-145955a3-ae67-414e-b453-8e4a542bd4a0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 945 time: 0.0691121 Nov 16 03:23:54.356714 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f7c6dc7b-1f2c-477c-a4bc-92dd30f5afb1 req-0b2daffc-1fed-4056-af01-c70702268119 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0686419 Nov 16 03:23:54.384898 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49648) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:54.437859 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01cb610c-d062-4259-833b-eff9e397c562 tempest-TestVolumeBootPattern-1638411920 tempest-TestVolumeBootPattern-1638411920-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:54.439450 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-01cb610c-d062-4259-833b-eff9e397c562 tempest-TestVolumeBootPattern-1638411920 tempest-TestVolumeBootPattern-1638411920-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1093 time: 0.0530941 Nov 16 03:23:54.442486 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49654) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:54.447175 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'tenant_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address': '172.20.0.5'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:23:54.476707 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:54.603306 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:54.741316 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Allocated IP 172.27.1.185 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/2d3a92f0-21fd-44ae-8b6e-177fe3cf7561) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:23:54.875375 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49682) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:54.882162 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:54.922284 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:54.983609 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:23:54.987841 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:23:54.995270 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:23:55.025753 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=2d3a92f0-21fd-44ae-8b6e-177fe3cf7561,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:55.274956 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.397306 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:23:55.508611 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:55.523358 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '338936ea-fa25-4065-9970-6d7171659768', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'port_id': '338936ea-fa25-4065-9970-6d7171659768', 'mac_address': 'fa:16:3e:89:7e:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:23:55.556391 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf7e7b4d-9ff0-4f87-bc57-7c76c9cbc3b2 req-643f842b-7822-411a-80a4-f8e9402b5783 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:55.557065 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Deleting port 18838d54-2a88-461c-8662-98ba7ad9f972 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:23:55.557543 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.557925 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cf7e7b4d-9ff0-4f87-bc57-7c76c9cbc3b2 req-643f842b-7822-411a-80a4-f8e9402b5783 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.2296200 Nov 16 03:23:55.568852 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.584964 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 338936ea-fa25-4065-9970-6d7171659768 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:23:55.611944 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:55.618703 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.624550 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.672282 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:55.684578 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] For port 18838d54-2a88-461c-8662-98ba7ad9f972, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=18838d54-2a88-461c-8662-98ba7ad9f972,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:55.685281 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.701706 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Calling delete_port for 18838d54-2a88-461c-8662-98ba7ad9f972 owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:23:55.709678 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cf7e7b4d-9ff0-4f87-bc57-7c76c9cbc3b2 req-8d323b36-347b-4802-9643-b76b856d7d73 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1445007 Nov 16 03:23:55.760097 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.935192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['338936ea-fa25-4065-9970-6d7171659768'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:23:55.943865 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.954587 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.959750 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:55.990198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Pushing event deleted for resources: {'Port': ['ID=18838d54-2a88-461c-8662-98ba7ad9f972,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:56.208059 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:56.314804 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=2d3a92f0-21fd-44ae-8b6e-177fe3cf7561,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:56.334445 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:56.449376 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Floating IP a7808eec-cf97-4b52-98c8-df3a500d6adb associated. External IP: 172.27.1.185, port: e037ab2a-67a2-4571-bb58-938a1ea5e8c9. Nov 16 03:23:56.470892 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:23:56.604399 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:56.612216 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-eeef364d-c8b7-48ba-a367-1b01ca791424 admin admin] 10.222.0.31 "PUT /v2.0/routers/0f03a58b-d978-4d06-8b7c-905f27fd0d8a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7345519 Nov 16 03:23:56.615345 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49686) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:56.617390 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] Sync routers for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:56.635757 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:56.636538 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:56.784193 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:56.787326 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:23:56.788875 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks [] for router, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.003499 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992b8a26-689b-40f9-b443-1a21e513bf0c req-533ff0de-6eb4-4492-b465-28e275a7a22e tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:57.005045 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-992b8a26-689b-40f9-b443-1a21e513bf0c req-533ff0de-6eb4-4492-b465-28e275a7a22e tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 945 time: 0.1759636 Nov 16 03:23:57.005406 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:23:55Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:57.038524 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] Checking router: 0f03a58b-d978-4d06-8b7c-905f27fd0d8a for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:57.049116 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] Routers {'0f03a58b-d978-4d06-8b7c-905f27fd0d8a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:57.049778 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:57.056470 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.068468 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:23:57.086642 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:23:57.099508 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:57.100178 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:57.125980 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.152029 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-992b8a26-689b-40f9-b443-1a21e513bf0c req-ef21481a-52f7-415b-a68e-7bda5f4d30a5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1338863 Nov 16 03:23:57.169352 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8e2431f6-b2cd-4192-9aac-4b2f7fa8c211 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.7254100 Nov 16 03:23:57.173111 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:57.175546 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e" -d '{"events": [{"name": "network-changed", "server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:57.182325 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] Set router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:57.191103 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Deleting port 93c3618c-4f4c-42ad-9e08-086de4fab231 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:23:57.191448 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.231191 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78346620-6df8-45f0-b5df-f1317524d7e7 x-openstack-request-id: req-78346620-6df8-45f0-b5df-f1317524d7e7 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:57.231533 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:57.231926 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-78346620-6df8-45f0-b5df-f1317524d7e7 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:57.232465 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'status': 'completed', 'code': 200} Nov 16 03:23:57.240071 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:57.316227 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] For port 93c3618c-4f4c-42ad-9e08-086de4fab231, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=93c3618c-4f4c-42ad-9e08-086de4fab231,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:57.317096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.335810 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Calling delete_port for 93c3618c-4f4c-42ad-9e08-086de4fab231 owned by network:router_gateway {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:23:57.420140 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:23:55Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:57.421108 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-704f4d3e-674e-4632-b40b-e62201569f7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:57.422667 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-704f4d3e-674e-4632-b40b-e62201569f7d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1098 time: 0.1508400 Nov 16 03:23:57.452219 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:23:57.480623 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63a93e37-bfab-4495-af8b-5c716558860b None None] The sync data for ids ['0f03a58b-d978-4d06-8b7c-905f27fd0d8a'] in dv-cinder-818037-1-iscsi is: [{'id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'name': 'tempest-TestMinimumBasicScenario-786760365-router', 'tenant_id': '76754ec1f4b143ceabbcb17af1aa513b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178'}], 'enable_snat': True}, 'gw_port_id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:23:55Z', 'revision_number': 5, 'project_id': '76754ec1f4b143ceabbcb17af1aa513b', 'gw_port': {'id': '93c3618c-4f4c-42ad-9e08-086de4fab231', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:55:73:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f03a58b-d978-4d06-8b7c-905f27fd0d8a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.178', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:05Z', 'updated_at': '2021-11-16T03:20:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:57.515649 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 338936ea-fa25-4065-9970-6d7171659768 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:23:57.520242 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 338936ea-fa25-4065-9970-6d7171659768 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:23:57.520971 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.608102 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:57.632236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.632987 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-08930aab-d0dc-48b6-8311-6baeebf58bba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:57.634498 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-08930aab-d0dc-48b6-8311-6baeebf58bba service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.2031178 Nov 16 03:23:57.637656 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:23:57.649361 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:23:57.650107 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:57.658591 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:23:57.660998 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc02db77-8a7d-487b-914c-3d02f43051e9" -d '{"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-plugged", "status": "completed", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:23:57.675857 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:57.682590 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.683584 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 373f70dc-3a64-458a-a38c-adab3f4f3275 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:57.711074 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:23:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57b41c1d-fa29-4eb6-bb9c-324dc089d2b4 x-openstack-request-id: req-57b41c1d-fa29-4eb6-bb9c-324dc089d2b4 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:23:57.711314 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-plugged", "status": "completed", "tag": "338936ea-fa25-4065-9970-6d7171659768", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:23:57.711613 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-57b41c1d-fa29-4eb6-bb9c-324dc089d2b4 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:23:57.711955 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'code': 200} Nov 16 03:23:57.717868 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-63789d26-7be5-4613-ac41-eaff6a26f4ac service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 200 len: 999 time: 0.0747132 Nov 16 03:23:57.718874 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.774940 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Pushing event deleted for resources: {'Port': ['ID=93c3618c-4f4c-42ad-9e08-086de4fab231,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:57.799611 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:23:57.862109 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:57.866031 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-ca29a0f2-ae75-49f2-ace3-fc425209f3e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:57.867800 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-ca29a0f2-ae75-49f2-ace3-fc425209f3e9 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0898166 Nov 16 03:23:57.905166 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 373f70dc-3a64-458a-a38c-adab3f4f3275 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:23:57.905524 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 373f70dc-3a64-458a-a38c-adab3f4f3275 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:23:57.938055 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:58.035556 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.039968 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.134270 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-a2ddec75-2c65-4de3-b091-b0bbeb0459d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:58.136111 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-a2ddec75-2c65-4de3-b091-b0bbeb0459d5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2533338 Nov 16 03:23:58.173134 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:58.175585 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.176078 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f03a58b-d978-4d06-8b7c-905f27fd0d8a {{(pid=101899) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:23:58.181120 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.182277 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a6dcab23-47e2-49e5-aa07-23a1a12515a6 admin admin] 10.222.0.31 "DELETE /v2.0/routers/0f03a58b-d978-4d06-8b7c-905f27fd0d8a HTTP/1.1" status: 204 len: 168 time: 1.5653510 Nov 16 03:23:58.185603 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49696) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:58.210097 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed394778-7e1e-439c-99ef-844c0ccff567 None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:23:58.238551 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c796fd5c-3409-440c-aba1-35a99d78d395 req-ae20f496-99c8-41e8-82d1-02f05cda2bd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:58.240052 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c796fd5c-3409-440c-aba1-35a99d78d395 req-ae20f496-99c8-41e8-82d1-02f05cda2bd1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1099 time: 0.1223969 Nov 16 03:23:58.272764 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Deleting subnet e24021b9-c30d-4d4e-b10a-332e32fda211 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:23:58.279688 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.288251 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-34417a09-78ec-4c49-a9f6-7662637b3617 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1346743 Nov 16 03:23:58.350224 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.502968 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.541538 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01232286-1f84-460c-b651-2b7274ec3e3a None None] New status for floating IP a7808eec-cf97-4b52-98c8-df3a500d6adb: ACTIVE {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:23:58.563767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.591584 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e24021b9-c30d-4d4e-b10a-332e32fda211,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:58.607701 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.615033 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1d4a8900-ca3c-4f79-81a0-183311a86c9b admin admin] 10.222.0.31 "DELETE /v2.0/subnets/e24021b9-c30d-4d4e-b10a-332e32fda211 HTTP/1.1" status: 204 len: 168 time: 0.4280705 Nov 16 03:23:58.615818 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49700) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:58.643999 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9606a5f7-407e-4bf5-a0d0-beb75b503c55 None None] Network 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:23:58.660760 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c796fd5c-3409-440c-aba1-35a99d78d395 req-c72170fa-8bce-4dc8-a013-849c1b96674b service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4094186 Nov 16 03:23:58.693721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1f06be-541e-494b-987b-59f6c82eeea5 req-e19b9370-41cd-42b0-9b36-6f7c25da2d16 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:58.693721 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1d1f06be-541e-494b-987b-59f6c82eeea5 req-e19b9370-41cd-42b0-9b36-6f7c25da2d16 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.3749599 Nov 16 03:23:58.717151 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.748805 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-debb41c7-5ddf-4aaa-b8ac-31b82870d06e req-db751acf-ffdf-4bef-9743-62e6a9409b3c service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4488807 Nov 16 03:23:58.774098 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1d1f06be-541e-494b-987b-59f6c82eeea5 req-c98fd89a-eb61-4eeb-8112-4cfdfb9010ed tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0753195 Nov 16 03:23:58.777596 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Deleting port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:23:58.777959 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.893499 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] For port a408a5bf-cfc4-4a7b-8915-40551a3c2e41, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,segment=NetworkSegment(25def757-4057-49a6-b5ef-3a5e0b9904b2),segment_id=25def757-4057-49a6-b5ef-3a5e0b9904b2)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:23:58.893766 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:58.917162 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Calling delete_port for a408a5bf-cfc4-4a7b-8915-40551a3c2e41 owned by network:dhcp {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:23:59.025827 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.040755 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b0a540c-4162-4045-95e5-45fb9c499d93 None None] DHCP port deletion for 3d7e4ea5-05db-41ca-8436-96b38d0ef4ef request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:23:59.055200 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Pushing event deleted for resources: {'Port': ['ID=a408a5bf-cfc4-4a7b-8915-40551a3c2e41,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:59.063410 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] No DVR routers for this DVR port a408a5bf-cfc4-4a7b-8915-40551a3c2e41 on host dv-cinder-818037-1-iscsi {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:23:59.143375 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.165876 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3d7e4ea5-05db-41ca-8436-96b38d0ef4ef']}} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:59.177500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '25def757-4057-49a6-b5ef-3a5e0b9904b2') {'for_net_delete': True} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:59.177767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '25def757-4057-49a6-b5ef-3a5e0b9904b2') {} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:23:59.190506 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129419530'] for segment, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.206480 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.213940 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Releasing vlan 337 on physical network physnet1 to pool {{(pid=101898) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:23:59.214535 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-128585750'] for segment, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: Traceback (most recent call last): Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: timer() Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: cb(*args, **kw) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: return func(*args, **kwargs) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: self._notify() Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: self.callback(batched_events) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: event.method(event) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: return f(self, *a, **k) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._get(url).json() Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: return self.request(url, 'GET', **kwargs) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:23:59.216635 dv-cinder-818037-1-iscsi neutron-server[101898]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:23:59.281292 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.287075 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.292629 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] 10.222.0.31 "DELETE /v2.0/networks/3d7e4ea5-05db-41ca-8436-96b38d0ef4ef HTTP/1.1" status: 204 len: 168 time: 0.6755433 Nov 16 03:23:59.295838 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49702) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:23:59.318071 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e629856-a793-459d-9c3a-905eb6ee02e6 admin admin] Pushing event deleted for resources: {'Network': ['ID=3d7e4ea5-05db-41ca-8436-96b38d0ef4ef,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:23:59.407812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a408a5bf-cfc4-4a7b-8915-40551a3c2e41 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:59.430012 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: a408a5bf-cfc4-4a7b-8915-40551a3c2e41 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:23:59.430233 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a408a5bf-cfc4-4a7b-8915-40551a3c2e41 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:23:59.430664 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 18838d54-2a88-461c-8662-98ba7ad9f972 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:59.453948 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 18838d54-2a88-461c-8662-98ba7ad9f972 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:23:59.454296 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 18838d54-2a88-461c-8662-98ba7ad9f972 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:23:59.454714 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 93c3618c-4f4c-42ad-9e08-086de4fab231 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:23:59.476418 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 93c3618c-4f4c-42ad-9e08-086de4fab231 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:23:59.476785 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 93c3618c-4f4c-42ad-9e08-086de4fab231 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:23:59.801216 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:23:59.915385 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd16a3b-abb1-4dcb-a5fb-10717991b0a8 req-53a6243c-dcff-4075-b62a-b4273f3bb84d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:23:59.917183 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3bd16a3b-abb1-4dcb-a5fb-10717991b0a8 req-53a6243c-dcff-4075-b62a-b4273f3bb84d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0557213 Nov 16 03:23:59.988001 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3bd16a3b-abb1-4dcb-a5fb-10717991b0a8 req-6611c131-261a-4b42-8b81-c91bca87a117 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0612473 Nov 16 03:24:00.103037 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Deleting port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:24:00.103302 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:00.191540 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] For port 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:00.192254 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:00.205028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Calling delete_port for 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:24:00.408911 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:00.439200 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Pushing event deleted for resources: {'Port': ['ID=9e3470c9-1e02-43ea-b495-8bf9b1bb7ece,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:00.610661 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:00.835979 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Router f7404732-3a06-4890-aa0d-eeb65e2af688 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:24:00.947149 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:24:00.952542 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-5e77cd6e-a4ab-4c5d-bd19-dff72606bba2 admin admin] 10.222.0.31 "PUT /v2.0/routers/f7404732-3a06-4890-aa0d-eeb65e2af688/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6545863 Nov 16 03:24:00.955298 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49706) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:00.957565 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] Sync routers for ids ['f7404732-3a06-4890-aa0d-eeb65e2af688'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:24:00.968642 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] Routers {'f7404732-3a06-4890-aa0d-eeb65e2af688'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:00.969238 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f7404732-3a06-4890-aa0d-eeb65e2af688'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:01.064232 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks [] for router, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.169407 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] Set router f7404732-3a06-4890-aa0d-eeb65e2af688 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:01.183342 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b1ef18-2e2b-4a8f-b4d3-57ac99d6440b req-3f8e8d84-6f46-4c98-8e5f-a250e4de92d9 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:01.184863 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23b1ef18-2e2b-4a8f-b4d3-57ac99d6440b req-3f8e8d84-6f46-4c98-8e5f-a250e4de92d9 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.1224172 Nov 16 03:24:01.220385 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.273409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23b1ef18-2e2b-4a8f-b4d3-57ac99d6440b req-cab12364-38c7-48c0-bb68-0332ec8ee276 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779469 Nov 16 03:24:01.303957 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Deleting port 0b1cf2da-edeb-4070-b40d-fbc30d8735db {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:24:01.304300 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.376025 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216'}], 'enable_snat': True}, 'gw_port_id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:24:00Z', 'revision_number': 5, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port': {'id': '0b1cf2da-edeb-4070-b40d-fbc30d8735db', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 489, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:15Z', 'updated_at': '2021-11-16T03:20:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:01.405668 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] Checking router: f7404732-3a06-4890-aa0d-eeb65e2af688 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:24:01.414871 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] Routers {'f7404732-3a06-4890-aa0d-eeb65e2af688'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:01.415509 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f7404732-3a06-4890-aa0d-eeb65e2af688'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:01.422814 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] For port 0b1cf2da-edeb-4070-b40d-fbc30d8735db, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=0b1cf2da-edeb-4070-b40d-fbc30d8735db,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:01.423197 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.439277 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Calling delete_port for 0b1cf2da-edeb-4070-b40d-fbc30d8735db owned by network:router_gateway {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:24:01.459559 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d7450e-86cd-4d6c-b61a-230e1d73e96c req-1461d444-e339-4a9c-af5b-430defd34269 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:01.461110 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b9d7450e-86cd-4d6c-b61a-230e1d73e96c req-1461d444-e339-4a9c-af5b-430defd34269 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0935519 Nov 16 03:24:01.505953 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] Set router f7404732-3a06-4890-aa0d-eeb65e2af688 gateway port host: None {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:01.559596 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:24:01Z', 'revision_number': 6, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port_host': None}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:01.589103 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b9d7450e-86cd-4d6c-b61a-230e1d73e96c req-2aaf4354-37a3-4825-8737-92980f13cff0 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0927622 Nov 16 03:24:01.589794 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84d7024e-acfd-432a-9be3-988ea4ceb6db None None] The sync data for ids ['f7404732-3a06-4890-aa0d-eeb65e2af688'] in dv-cinder-818037-1-iscsi is: [{'id': 'f7404732-3a06-4890-aa0d-eeb65e2af688', 'name': 'tempest-TestMinimumBasicScenario-1727128492-router', 'tenant_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:14Z', 'updated_at': '2021-11-16T03:24:01Z', 'revision_number': 6, 'project_id': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'gw_port_host': None}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:24:01.614209 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49712) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:01.667909 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.698205 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Pushing event deleted for resources: {'Port': ['ID=0b1cf2da-edeb-4070-b40d-fbc30d8735db,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:01.761812 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.876714 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.879555 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.930201 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8271a18-f533-493f-866e-6aa494fe77df tempest-TestShelveInstance-1182260209 tempest-TestShelveInstance-1182260209-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:01.933787 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f8271a18-f533-493f-866e-6aa494fe77df tempest-TestShelveInstance-1182260209 tempest-TestShelveInstance-1182260209-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1094 time: 0.3164535 Nov 16 03:24:01.935233 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49716) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:01.940206 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'port_id': '338936ea-fa25-4065-9970-6d7171659768', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'fixed_ip_address': '172.20.0.14'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:01.946032 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.946576 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Fanout notify agent at l3_agent the message router_deleted on router f7404732-3a06-4890-aa0d-eeb65e2af688 {{(pid=101899) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:24:01.954134 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:01.955419 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-76eb4318-b50e-4083-be10-de6986a5687c admin admin] 10.222.0.31 "DELETE /v2.0/routers/f7404732-3a06-4890-aa0d-eeb65e2af688 HTTP/1.1" status: 204 len: 168 time: 0.9991355 Nov 16 03:24:01.958925 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49718) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:01.971800 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for floatingip, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.093952 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.212770 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Allocated IP 172.27.1.6 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/9a78e600-5b35-4316-96be-fbc4bd8adc68) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:24:02.293277 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Deleting subnet d0585411-56ad-49f6-aff5-68e4e82ba7bd {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:24:02.296492 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.322151 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.330276 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.365949 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.403440 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:24:02.407847 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:24:02.410664 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:24:02.420028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.443750 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'Port': ['ID=9a78e600-5b35-4316-96be-fbc4bd8adc68,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:02.482953 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.510193 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d0585411-56ad-49f6-aff5-68e4e82ba7bd,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:02.514401 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.519743 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6acf517c-735e-4e67-9a37-23763c3cb0ca None None] Network 9718c5ed-4646-4da1-b02e-63257534ec52 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:24:02.521704 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-748a7c69-1bb7-4d4c-85e4-697c0ffea74f admin admin] 10.222.0.31 "DELETE /v2.0/subnets/d0585411-56ad-49f6-aff5-68e4e82ba7bd HTTP/1.1" status: 204 len: 168 time: 0.5570893 Nov 16 03:24:02.522162 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49720) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:02.682023 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.757171 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] DHCP port deletion for 9718c5ed-4646-4da1-b02e-63257534ec52 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:24:02.810206 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] Deleting port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 {{(pid=101900) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:24:02.810924 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.871803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Deleting port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:24:02.872160 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.876972 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] For port 1e2f4993-ec18-42fa-8228-1bee6190ecb5, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=1e2f4993-ec18-42fa-8228-1bee6190ecb5,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:02.877405 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.894789 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] Calling delete_port for 1e2f4993-ec18-42fa-8228-1bee6190ecb5 owned by network:dhcp {{(pid=101900) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:24:02.931924 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.965339 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] For port 1e2f4993-ec18-42fa-8228-1bee6190ecb5, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=1e2f4993-ec18-42fa-8228-1bee6190ecb5,segment=NetworkSegment(b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f),segment_id=b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:02.966165 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:02.984672 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Calling delete_port for 1e2f4993-ec18-42fa-8228-1bee6190ecb5 owned by network:dhcp {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:24:03.009301 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765'] for port, after_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.040140 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] Pushing event deleted for resources: {'Port': ['ID=1e2f4993-ec18-42fa-8228-1bee6190ecb5,revision_number=None']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:03.042283 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b55ade1-247a-4e31-a412-5bf80e8beec3 None None] No DVR routers for this DVR port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 on host dv-cinder-818037-1-iscsi {{(pid=101900) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:24:03.064676 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.168345 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.208849 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Pushing event deleted for resources: {'Port': ['ID=1e2f4993-ec18-42fa-8228-1bee6190ecb5,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:03.210691 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] No DVR routers for this DVR port 1e2f4993-ec18-42fa-8228-1bee6190ecb5 on host dv-cinder-818037-1-iscsi {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:24:03.310478 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.339561 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9718c5ed-4646-4da1-b02e-63257534ec52']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:03.354503 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.357088 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:03.357613 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b6587f1d-b73c-4ea6-bd79-c7a34ebf1f4f') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:03.364975 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.370447 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 0b1cf2da-edeb-4070-b40d-fbc30d8735db no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:24:03.372422 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.392405 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 0b1cf2da-edeb-4070-b40d-fbc30d8735db {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:24:03.392830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 0b1cf2da-edeb-4070-b40d-fbc30d8735db not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:24:03.393290 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 1e2f4993-ec18-42fa-8228-1bee6190ecb5 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:24:03.412673 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 1e2f4993-ec18-42fa-8228-1bee6190ecb5 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:24:03.413002 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 1e2f4993-ec18-42fa-8228-1bee6190ecb5 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:24:03.413406 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:24:03.433041 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:24:03.433376 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 9e3470c9-1e02-43ea-b495-8bf9b1bb7ece not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:24:03.449446 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.463985 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Releasing vlan 301 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:24:03.464417 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: self.session.flush() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: self.session.flush() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: self.session.flush() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: self.session.flush() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:24:03.467934 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:24:03.477283 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event updated for resources: {'Port': ['ID=9a78e600-5b35-4316-96be-fbc4bd8adc68,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:03.504943 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.590649 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.595229 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.598444 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] 10.222.0.31 "DELETE /v2.0/networks/9718c5ed-4646-4da1-b02e-63257534ec52 HTTP/1.1" status: 204 len: 168 time: 1.0755911 Nov 16 03:24:03.616557 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b1cb7b-7bb1-423c-be76-d8c5efdd9a6e admin admin] Pushing event deleted for resources: {'Network': ['ID=9718c5ed-4646-4da1-b02e-63257534ec52,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:03.640264 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Floating IP e553aab9-91a2-4f73-91d4-0a64f7bc2eed associated. External IP: 172.27.1.6, port: 338936ea-fa25-4065-9970-6d7171659768. Nov 16 03:24:03.780723 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49724) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:03.830629 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-cf9caf86-382e-4e7d-82bd-3ff0e95996ee admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=76754ec1f4b143ceabbcb17af1aa513b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0486257 Nov 16 03:24:03.833157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49726) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:03.886587 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-63cc3747-90b0-49cd-9380-5b1dfcbb1dd6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.910044 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-63cc3747-90b0-49cd-9380-5b1dfcbb1dd6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.968334 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-63cc3747-90b0-49cd-9380-5b1dfcbb1dd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.971486 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-63cc3747-90b0-49cd-9380-5b1dfcbb1dd6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:03.974112 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-63cc3747-90b0-49cd-9380-5b1dfcbb1dd6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/baadeb48-7237-4752-a8bf-62e69b7ab85b HTTP/1.1" status: 204 len: 168 time: 0.1396878 Nov 16 03:24:03.996442 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63cc3747-90b0-49cd-9380-5b1dfcbb1dd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=baadeb48-7237-4752-a8bf-62e69b7ab85b,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:04.115014 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-57dc7fe3-48a2-475c-8c91-1691c24ddd67 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1103756 Nov 16 03:24:04.162712 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Router 95164b65-5103-4ebd-944c-7883a34b1f32 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:24:04.287547 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-5c45d793-b36c-477b-861a-c3220b2a13c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:04.289166 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-5c45d793-b36c-477b-861a-c3220b2a13c7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 1100 time: 0.1162629 Nov 16 03:24:04.306362 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:24:04.319254 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] Sync routers for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:24:04.327579 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:04.336398 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:04.337169 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:04.342112 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49732) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:04.384910 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-060bc609-d17b-449e-997d-06f05ad138e0 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ba3f648fc9dd4cd3b5f5d20f45efc3fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0419123 Nov 16 03:24:04.387289 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49734) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:04.418745 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a6ed966e-7c28-4889-9889-48ee916cf748 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.4816515 Nov 16 03:24:04.426781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:24:04.430654 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54770872-0f65-4f70-890e-3863d4a691b4" -d '{"events": [{"name": "network-changed", "server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:24:04.443906 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5b03a68-bf4d-48bf-9028-345362b6b65e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:04.464685 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:04.466709 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5b03a68-bf4d-48bf-9028-345362b6b65e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:04.482852 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:24:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71c69ab5-7b03-45c5-ac90-7fdb59383d49 x-openstack-request-id: req-71c69ab5-7b03-45c5-ac90-7fdb59383d49 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:24:04.483146 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "tag": "338936ea-fa25-4065-9970-6d7171659768", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:24:04.483584 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-71c69ab5-7b03-45c5-ac90-7fdb59383d49 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:24:04.484037 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'status': 'completed', 'code': 200} Nov 16 03:24:04.485792 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-baf22730-534a-4f20-93cb-c51fba0d7fb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:04.487314 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-baf22730-534a-4f20-93cb-c51fba0d7fb4 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.1339438 Nov 16 03:24:04.523804 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5b03a68-bf4d-48bf-9028-345362b6b65e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:04.526998 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c5b03a68-bf4d-48bf-9028-345362b6b65e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:04.530970 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c5b03a68-bf4d-48bf-9028-345362b6b65e admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/9839d4a9-1d1d-4a8d-a332-c0bb734ceb93 HTTP/1.1" status: 204 len: 168 time: 0.1399868 Nov 16 03:24:04.537919 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b03a68-bf4d-48bf-9028-345362b6b65e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9839d4a9-1d1d-4a8d-a332-c0bb734ceb93,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:04.618188 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-371c44be-1ff7-40f0-95b9-e3f83e5401d2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 200 len: 1002 time: 0.1032112 Nov 16 03:24:04.620722 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54770872-0f65-4f70-890e-3863d4a691b4 req-7eacb03c-3d7e-42fd-bd81-1736524427e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:04.622297 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-7eacb03c-3d7e-42fd-bd81-1736524427e1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1099 time: 0.1005127 Nov 16 03:24:04.735736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-81740eea-d35e-4f8b-ade6-aa9f741ae26d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:04.737265 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-81740eea-d35e-4f8b-ade6-aa9f741ae26d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.1037385 Nov 16 03:24:04.762878 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'e553aab9-91a2-4f73-91d4-0a64f7bc2eed', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'floating_ip_address': '172.27.1.6', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'port_id': '338936ea-fa25-4065-9970-6d7171659768', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'mac_address': 'fa:16:3e:89:7e:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:24:02Z', 'updated_at': '2021-11-16T03:24:02Z', 'revision_number': 0, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:04.793920 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] Checking router: 95164b65-5103-4ebd-944c-7883a34b1f32 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:24:04.798282 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54770872-0f65-4f70-890e-3863d4a691b4 req-5e4aeb51-9ab1-4682-b264-aa92a69f6006 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:04.799724 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-5e4aeb51-9ab1-4682-b264-aa92a69f6006 service neutron] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 909 time: 0.1648295 Nov 16 03:24:04.804895 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:04.805611 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:23:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:04.819448 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-94268157-0ff1-48e0-95e1-313df36797a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:04.821057 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-94268157-0ff1-48e0-95e1-313df36797a9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0738709 Nov 16 03:24:04.936908 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-f05f9233-aaf0-4a33-a82d-53909b5af448 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 998 time: 0.1275928 Nov 16 03:24:04.946119 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:04.998080 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-3e74182e-70bb-4d3b-8634-7bf2c24e00b3 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1459365 Nov 16 03:24:05.015843 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54770872-0f65-4f70-890e-3863d4a691b4 req-bf002115-2faa-4a47-aab6-6242ced143e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:05.017313 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-bf002115-2faa-4a47-aab6-6242ced143e2 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.0680897 Nov 16 03:24:05.123460 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54770872-0f65-4f70-890e-3863d4a691b4 req-da3ea2ef-342f-4ab3-9206-689c39e44c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:05.124975 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-da3ea2ef-342f-4ab3-9206-689c39e44c35 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0956817 Nov 16 03:24:05.144788 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6c20887-41a1-4f94-9325-0af7d39a4cf8 req-bcf2e2da-74ba-4173-ab82-244f5b0d1a10 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1379755 Nov 16 03:24:05.239044 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-2fcd7086-3c9b-4eb9-9e54-bd9583d822b1 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1043069 Nov 16 03:24:05.316489 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'e553aab9-91a2-4f73-91d4-0a64f7bc2eed', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'floating_ip_address': '172.27.1.6', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'port_id': '338936ea-fa25-4065-9970-6d7171659768', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'mac_address': 'fa:16:3e:89:7e:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:24:02Z', 'updated_at': '2021-11-16T03:24:02Z', 'revision_number': 0, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:05.340066 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-54770872-0f65-4f70-890e-3863d4a691b4 req-cf38f8f7-9a2c-42c0-8f38-c5a555f99d12 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938931 Nov 16 03:24:05.343093 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778a6413-7bff-4870-955d-1a9fa8437c6b None None] The sync data for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi is: [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'e553aab9-91a2-4f73-91d4-0a64f7bc2eed', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'floating_ip_address': '172.27.1.6', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'port_id': '338936ea-fa25-4065-9970-6d7171659768', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'mac_address': 'fa:16:3e:89:7e:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:24:02Z', 'updated_at': '2021-11-16T03:24:02Z', 'revision_number': 0, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:24:05.541833 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74fd7bf3-1057-4aa9-a5df-de45714a4e91 None None] New status for floating IP e553aab9-91a2-4f73-91d4-0a64f7bc2eed: ACTIVE {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:24:05.876418 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:14.362522 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-c144ad1c-450e-42f1-b660-b3a0f1e2b149 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:18.459661 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-19fa3b10-74f3-4c38-b163-bf20a22a66d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:19.781996 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:21.516913 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:21.592181 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:27.139442 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:24:29.347232 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cee7e91-6f2e-4a90-a88c-54533f3ab26f req-9a5e1861-1e12-4669-af9b-6542f82c0ecf tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:29.348701 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1cee7e91-6f2e-4a90-a88c-54533f3ab26f req-9a5e1861-1e12-4669-af9b-6542f82c0ecf tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.0565531 Nov 16 03:24:29.402776 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1cee7e91-6f2e-4a90-a88c-54533f3ab26f req-0dfaa8d1-5b1c-4809-99f5-2881f6de4663 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476701 Nov 16 03:24:30.549786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c24b3ef-195e-484b-8830-9fe656159ed7 req-beb9c28f-98a7-44df-be80-85fb785741fb tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:30.551405 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c24b3ef-195e-484b-8830-9fe656159ed7 req-beb9c28f-98a7-44df-be80-85fb785741fb tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.0548315 Nov 16 03:24:30.604575 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9c24b3ef-195e-484b-8830-9fe656159ed7 req-482f3323-b26a-477f-9c03-c524a639f307 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471473 Nov 16 03:24:31.074966 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-eee9e189-a2d4-4506-b05e-5d9e5af921c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:31.076425 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-eee9e189-a2d4-4506-b05e-5d9e5af921c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.0502331 Nov 16 03:24:31.179631 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Deleting port c8dba4d7-4e08-40c8-a119-0e68144a64b1 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:24:31.179892 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:31.281613 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] For port c8dba4d7-4e08-40c8-a119-0e68144a64b1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=c8dba4d7-4e08-40c8-a119-0e68144a64b1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:31.281993 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:31.606012 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:31.606770 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:31.606770 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Floating IP 13eb19b9-ca5d-492e-b510-67de784326d3 disassociated. External IP: 172.27.1.105, port: c8dba4d7-4e08-40c8-a119-0e68144a64b1. Nov 16 03:24:31.606995 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Calling delete_port for c8dba4d7-4e08-40c8-a119-0e68144a64b1 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:24:31.775028 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642ed19b-e081-4bab-908b-36c6536512c3 req-1d26e7c7-825f-4946-b441-ff01d11bd6c8 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:31.776781 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-642ed19b-e081-4bab-908b-36c6536512c3 req-1d26e7c7-825f-4946-b441-ff01d11bd6c8 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=f47ab019-3d1b-4bcf-8732-95f9728a909e HTTP/1.1" status: 200 len: 947 time: 0.0961075 Nov 16 03:24:31.778023 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:31.822275 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event deleted for resources: {'Port': ['ID=c8dba4d7-4e08-40c8-a119-0e68144a64b1,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:31.837083 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.837419 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.837777 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.838276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.838419 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.838760 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.839084 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.839403 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.839717 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.840032 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.840350 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.840651 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:31.933694 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-642ed19b-e081-4bab-908b-36c6536512c3 req-d34f9a40-f0dc-4567-b374-6b7a4b825cca tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1482830 Nov 16 03:24:31.978989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:24:32.095434 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:24:32.107920 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:24:32.121814 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:32.122756 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:24:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:32.137359 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] No DVR routers for this DVR port c8dba4d7-4e08-40c8-a119-0e68144a64b1 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:24:32.140361 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:32.144732 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70da1ab3-9f09-4c01-8497-3a804adf2237 req-fe6e5e2c-8d2b-4f80-9c7a-e90eaccad1c3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "DELETE /v2.0/ports/c8dba4d7-4e08-40c8-a119-0e68144a64b1 HTTP/1.1" status: 204 len: 173 time: 1.0606754 Nov 16 03:24:32.145149 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-deleted', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:24:32.147518 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ad734e5-ec5b-4464-a134-0d0cc59c56e2" -d '{"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-deleted", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:24:32.213415 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:24:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8fbd676-bb85-4bf2-a61a-79e71836cd30 x-openstack-request-id: req-b8fbd676-bb85-4bf2-a61a-79e71836cd30 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:24:32.213755 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f47ab019-3d1b-4bcf-8732-95f9728a909e", "name": "network-vif-deleted", "tag": "c8dba4d7-4e08-40c8-a119-0e68144a64b1", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:24:32.214042 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-b8fbd676-bb85-4bf2-a61a-79e71836cd30 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:24:32.214429 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f47ab019-3d1b-4bcf-8732-95f9728a909e', 'name': 'network-vif-deleted', 'tag': 'c8dba4d7-4e08-40c8-a119-0e68144a64b1', 'status': 'completed', 'code': 200} Nov 16 03:24:32.263044 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:32.487457 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:32.515141 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:24:32.524852 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:32.525490 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:24:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:32.637125 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:32.866846 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:32.902491 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b60a388-b3ac-428b-9502-872c943ef180 None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:24:33.043500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 49794) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:33.109464 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.152772 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.176870 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef1cc36-cb67-4e02-b679-79b8aaa18a7e None None] New status for floating IP 13eb19b9-ca5d-492e-b510-67de784326d3: DOWN {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:24:33.219474 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.223468 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.225066 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "DELETE /v2.0/security-groups/d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f HTTP/1.1" status: 204 len: 168 time: 0.1802621 Nov 16 03:24:33.229341 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49796) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:33.242782 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:33.251744 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.api.v2.resource [None req-4bc4c6e8-3182-45f9-a03b-e33498a4a6ed tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] show failed (client error): The resource could not be found. Nov 16 03:24:33.253951 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4bc4c6e8-3182-45f9-a03b-e33498a4a6ed tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups/d8544b57-fd77-41bc-85ab-4c4d7d8fcc0f HTTP/1.1" status: 404 len: 347 time: 0.0228932 Nov 16 03:24:33.257657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49798) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:33.259877 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.260392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.260916 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.261477 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.261992 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.262518 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.263046 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.263584 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.264117 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.264661 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.265175 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.265756 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd0a6ab9-7cd2-4e91-8273-ea2622d115f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:33.682205 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Deleting port 3f163731-0067-4fb6-a6bf-1ee31d60eede {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:24:33.682457 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.770239 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.770571 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.784474 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Calling delete_port for 3f163731-0067-4fb6-a6bf-1ee31d60eede owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:24:33.936679 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:33.963918 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event deleted for resources: {'Port': ['ID=3f163731-0067-4fb6-a6bf-1ee31d60eede,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:34.032839 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.036211 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.037607 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-48c5e81c-f4ab-4349-be2d-1eab52ce4a55 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "DELETE /v2.0/floatingips/13eb19b9-ca5d-492e-b510-67de784326d3 HTTP/1.1" status: 204 len: 168 time: 0.7783446 Nov 16 03:24:34.397061 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49804) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:34.402595 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'security_group': {'name': 'tempest-securitygroup--840436411', 'description': 'tempest-description--518100187'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:34.431420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.516017 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.523138 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.555494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.556790 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.1583059 Nov 16 03:24:34.559803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49806) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:34.566045 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'security_group_rule': {'security_group_id': '894ffe28-6a64-4566-8835-8f427b69c238', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:34.571919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6941bfc9-1d94-4d3a-8ed5-075f50893111 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'SecurityGroup': ['ID=894ffe28-6a64-4566-8835-8f427b69c238,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:34.601840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.664072 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.669604 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.691840 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17bcf728-eaf7-41b0-95f8-d0a3e3938a9b,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:34.700405 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.701712 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-3eb5aedd-e8cb-44de-93ec-5d660fda0696 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1409297 Nov 16 03:24:34.705156 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49808) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:34.709830 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'security_group_rule': {'security_group_id': '894ffe28-6a64-4566-8835-8f427b69c238', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:34.739521 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.810172 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.815668 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.833830 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eca16282-2772-4726-8a2d-57e2722956cb,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:34.843264 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.847558 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a2f7b888-6aa5-4ca7-a655-d9937dd182ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1385145 Nov 16 03:24:34.848113 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49810) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:34.852683 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:34.876441 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:34.989645 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.101544 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Allocated IP 172.27.1.85 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/4aa957d2-7b9f-4f5d-a385-8992760ae392) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:24:35.215964 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.250849 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.297620 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:24:35.300756 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:24:35.305174 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:24:35.308355 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'Port': ['ID=4aa957d2-7b9f-4f5d-a385-8992760ae392,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:35.397477 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.434425 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.555904 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:24:35.578024 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: c8dba4d7-4e08-40c8-a119-0e68144a64b1 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:24:35.578377 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device c8dba4d7-4e08-40c8-a119-0e68144a64b1 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:24:35.612582 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.622944 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.719312 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'Port': ['ID=4aa957d2-7b9f-4f5d-a385-8992760ae392,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:35.731171 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.749278 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.750851 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ba203a4c-f9fa-4545-85d9-b46abc8382b9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.9019775 Nov 16 03:24:35.894918 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:35.982668 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb3993a8-35aa-4dac-85b1-5d0738efe13e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--840436411&fields=id&tenant_id=2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 267 time: 0.0461259 Nov 16 03:24:36.096224 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-aba0260e-211e-4ff8-b989-66c1baf9c2a6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:36.097708 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-aba0260e-211e-4ff8-b989-66c1baf9c2a6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 816 time: 0.1079485 Nov 16 03:24:36.114482 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-4bb89f0f-460c-49d9-ab39-a4556ef92e37 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/quotas/2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 375 time: 0.0106912 Nov 16 03:24:36.180457 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-12c9c81c-6634-4991-94d6-087fd78da98e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0579584 Nov 16 03:24:36.286118 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-a6b7b71a-91b8-49e7-91f1-2d93b81149d7 service neutron] 10.222.0.31 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0930333 Nov 16 03:24:36.396731 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-668b0d42-5f5a-4998-ae40-d4c37783adcb service neutron] 10.222.0.31 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1005704 Nov 16 03:24:36.569624 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-75a9fd51-7613-4126-8659-4bd17c3ad6e6 req-08d4f4e7-ce6c-46fb-9a6e-45c981e3ee2a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 210 time: 0.0284488 Nov 16 03:24:37.683670 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-158adadf-cf3d-468b-b527-3974ac3b11c8 req-10ddf3ac-02a0-4992-8b40-8fcee84b2fd8 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 210 time: 0.0373399 Nov 16 03:24:37.732544 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fec598e8-6a8b-496a-a0bf-758c4485ba79 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:37.734396 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fec598e8-6a8b-496a-a0bf-758c4485ba79 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 816 time: 0.1371818 Nov 16 03:24:37.813320 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-ad3898c9-b2ac-41b4-957b-32543ef37ccf tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 379 time: 0.0589428 Nov 16 03:24:37.825867 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'port': {'device_id': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'admin_state_up': True, 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'security_groups': ['894ffe28-6a64-4566-8835-8f427b69c238']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:37.950845 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Made reservation on behalf of 2852179c69834bda8a41052f2d958cd4 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:24:37.954575 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.082339 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Allocated IP 172.20.0.5 (9af16874-689f-4be5-82a5-a21abe98a824/9e247800-f503-4caf-a4ea-6ee4bbc46e25/ec43ffb7-58ab-410e-be98-b04fa6fa5472) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:24:38.233824 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.269653 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.314340 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Network 9af16874-689f-4be5-82a5-a21abe98a824 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:24:38.317567 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:24:38.321463 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:24:38.345674 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:38.373660 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:38.374356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.392407 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-fb88205c-4d98-4d5d-a187-5cd3ed32cb12 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5704310 Nov 16 03:24:38.412076 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Request body: {'port': {'device_id': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:38.471943 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.540078 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-3b2c20f8-ddc4-44fd-b4fb-249b9b298fff None None] Provisioning complete for port ec43ffb7-58ab-410e-be98-b04fa6fa5472 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:24:38.540752 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-3b2c20f8-ddc4-44fd-b4fb-249b9b298fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.581042 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-3b2c20f8-ddc4-44fd-b4fb-249b9b298fff None None] Port ec43ffb7-58ab-410e-be98-b04fa6fa5472 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:24:38.745093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ec43ffb7-58ab-410e-be98-b04fa6fa5472 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:24:38.753926 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.768147 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Transition to ACTIVE for port object ec43ffb7-58ab-410e-be98-b04fa6fa5472 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:24:38.780405 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:38.860813 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:38.887542 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac76463-5c81-43bb-8c40-a572bb8f7d1f req-60665ba7-58e1-4471-bda5-bb70d23dde7d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:38.889093 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2ac76463-5c81-43bb-8c40-a572bb8f7d1f req-60665ba7-58e1-4471-bda5-bb70d23dde7d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.1193864 Nov 16 03:24:38.969332 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Attempting to bind port ec43ffb7-58ab-410e-be98-b04fa6fa5472 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:24:38.969651 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Attempting to bind port ec43ffb7-58ab-410e-be98-b04fa6fa5472 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:24:38.970004 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Attempting to bind port ec43ffb7-58ab-410e-be98-b04fa6fa5472 on network 9af16874-689f-4be5-82a5-a21abe98a824 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:24:38.976186 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2ac76463-5c81-43bb-8c40-a572bb8f7d1f req-d5cb0f41-7ccf-410f-9b73-90c92507008d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678582 Nov 16 03:24:38.978447 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Port ec43ffb7-58ab-410e-be98-b04fa6fa5472 on network 9af16874-689f-4be5-82a5-a21abe98a824 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:24:38.978767 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Attempting to bind port ec43ffb7-58ab-410e-be98-b04fa6fa5472 on network 9af16874-689f-4be5-82a5-a21abe98a824 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:24:38.984399 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 24, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:24:38.984734 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Checking segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:24:38.985202 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Bound using segment: {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:24:38.985727 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Bound port: ec43ffb7-58ab-410e-be98-b04fa6fa5472, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5625e5e7-479e-49a0-b312-cb57638f9297', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 347, 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:24:38.985908 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:39.055480 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:24:39.059174 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:24:39.065274 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:39.102540 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:39.103455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:39.104688 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] 10.222.0.11 "PUT /v2.0/ports/ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 200 len: 1093 time: 0.6974795 Nov 16 03:24:39.105135 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:24:39.107658 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b91319c5-5496-4e64-b100-f106c5767922" -d '{"events": [{"name": "network-changed", "server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:24:39.136766 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60957fd4-5c7e-4f05-9ab2-2149b7719eeb service neutron] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:39.160475 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:24:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65fa3968-d170-4372-ac08-bd3d6dba733c x-openstack-request-id: req-65fa3968-d170-4372-ac08-bd3d6dba733c {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:24:39.160774 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:24:39.161026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-65fa3968-d170-4372-ac08-bd3d6dba733c {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:24:39.161451 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'status': 'completed', 'code': 200} Nov 16 03:24:39.334597 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-9c9ff863-b88d-4a21-b851-5a7bdd9e36b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:39.336098 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-9c9ff863-b88d-4a21-b851-5a7bdd9e36b1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1096 time: 0.0439386 Nov 16 03:24:39.391708 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-c5f051bb-1bcb-45bb-a5da-dc2e9e4ab91c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 200 len: 217 time: 0.0398672 Nov 16 03:24:39.442497 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-73ae12f7-fd95-425f-a583-478972b309e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:39.443949 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-73ae12f7-fd95-425f-a583-478972b309e1 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0448611 Nov 16 03:24:39.491683 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-db829071-f0fc-405c-ab31-f0ea46331a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:39.493215 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-db829071-f0fc-405c-ab31-f0ea46331a51 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0423136 Nov 16 03:24:39.600965 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-93e06e9a-12d0-4866-8213-9a54f0e4076f service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0982065 Nov 16 03:24:39.702307 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-17b728c5-075e-4836-90c6-237b9a4056d5 req-c5f35622-e24e-47d0-815d-adcb870cb1e1 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916138 Nov 16 03:24:39.843825 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91319c5-5496-4e64-b100-f106c5767922 req-75b61e91-0161-45cf-b888-50dc3c50fe0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:39.845413 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-75b61e91-0161-45cf-b888-50dc3c50fe0d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1096 time: 0.0441761 Nov 16 03:24:39.948456 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91319c5-5496-4e64-b100-f106c5767922 req-8ea6338f-44c1-4141-bf73-893b110da173 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:39.949854 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-8ea6338f-44c1-4141-bf73-893b110da173 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.0967720 Nov 16 03:24:39.992874 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-e93e2d94-c64e-41a2-9c3c-ac76442cd1df service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 200 len: 217 time: 0.0350740 Nov 16 03:24:40.049987 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91319c5-5496-4e64-b100-f106c5767922 req-447a41f0-13ee-4fcf-b2b0-b5c6916c509d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:40.051534 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-447a41f0-13ee-4fcf-b2b0-b5c6916c509d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0506027 Nov 16 03:24:40.124619 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30701ad-568f-49e6-bdd6-4b0f714d0904 req-46e8ebeb-b80b-4196-b87c-ffa677fe6b23 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:40.126133 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a30701ad-568f-49e6-bdd6-4b0f714d0904 req-46e8ebeb-b80b-4196-b87c-ffa677fe6b23 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0723999 Nov 16 03:24:40.132034 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91319c5-5496-4e64-b100-f106c5767922 req-9fe3959a-3dde-4121-bc3f-60ccbc534372 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:40.133607 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-9fe3959a-3dde-4121-bc3f-60ccbc534372 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0704753 Nov 16 03:24:40.228597 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a30701ad-568f-49e6-bdd6-4b0f714d0904 req-741f1d1e-7a37-4063-97dd-6a8d0497582f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0940185 Nov 16 03:24:40.259670 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-a27b73d7-5423-4b9d-b5d6-90c135dfa7f7 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1083543 Nov 16 03:24:40.354909 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b91319c5-5496-4e64-b100-f106c5767922 req-8f71c28d-9472-4e69-ac6c-1c2ba2562e3e service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857098 Nov 16 03:24:41.374143 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3121c0b-bc25-4218-b9c2-e52dd958ca2f req-b92be460-fdc5-4b47-82b7-ca545a2d7998 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:41.375651 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3121c0b-bc25-4218-b9c2-e52dd958ca2f req-b92be460-fdc5-4b47-82b7-ca545a2d7998 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0657899 Nov 16 03:24:41.427717 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c3121c0b-bc25-4218-b9c2-e52dd958ca2f req-c96570e5-d45a-4cfd-b08b-84ef29447c03 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433955 Nov 16 03:24:42.560210 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3326d29-aa5c-4a66-b6df-b859a5dffbb8 req-4bd91934-08b7-493a-999b-2905e522eb4f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:42.561709 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3326d29-aa5c-4a66-b6df-b859a5dffbb8 req-4bd91934-08b7-493a-999b-2905e522eb4f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0568147 Nov 16 03:24:42.611310 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e3326d29-aa5c-4a66-b6df-b859a5dffbb8 req-1b7cafac-d91d-48e9-9e3c-4c4155713dd1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429912 Nov 16 03:24:43.585782 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:24:43.753999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8adf39f-cbb6-4251-81dd-c112928da730 req-3ceae0ab-fe73-48f0-bc2b-5d12a2bbc2e0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:43.755640 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b8adf39f-cbb6-4251-81dd-c112928da730 req-3ceae0ab-fe73-48f0-bc2b-5d12a2bbc2e0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0573630 Nov 16 03:24:43.809345 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b8adf39f-cbb6-4251-81dd-c112928da730 req-e949663a-cc20-4d25-8b8a-e6d12a054d13 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470493 Nov 16 03:24:43.841154 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:43.853556 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'mac_address': 'fa:16:3e:d0:78:15', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:24:43.892481 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:43.906791 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec43ffb7-58ab-410e-be98-b04fa6fa5472 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:24:43.930260 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:43.934866 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:43.989297 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:43.996821 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.997158 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.997516 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.997850 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.998176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.998497 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.999017 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.999187 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.999439 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:43.999968 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:44.000289 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:44.000600 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:24:44.253727 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['ec43ffb7-58ab-410e-be98-b04fa6fa5472'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:24:44.371715 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-95da9f4c-6539-4942-9cdf-8cf1ea69b809 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:44.939615 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ad2dbd2-15d8-450d-b884-abf95999d7ef req-0ff0d38d-0806-46c4-84c5-a33e6ea4958f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:44.941140 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3ad2dbd2-15d8-450d-b884-abf95999d7ef req-0ff0d38d-0806-46c4-84c5-a33e6ea4958f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 944 time: 0.0522130 Nov 16 03:24:44.992229 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3ad2dbd2-15d8-450d-b884-abf95999d7ef req-64a35a91-3989-4a45-8f3a-ef51c04f583f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442986 Nov 16 03:24:45.587328 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:24:45.647810 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port ec43ffb7-58ab-410e-be98-b04fa6fa5472 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:24:45.651461 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port ec43ffb7-58ab-410e-be98-b04fa6fa5472 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:24:45.651819 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:45.734825 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:45.758540 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:24:45.760811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48d14742-9b62-4acc-9ec5-4d50a523fc34" -d '{"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-plugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:24:45.777032 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:24:45.783858 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:45.808078 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:24:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-848a824f-9a83-429b-b278-939950e9887b x-openstack-request-id: req-848a824f-9a83-429b-b278-939950e9887b {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:24:45.808358 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-plugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:24:45.808603 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-848a824f-9a83-429b-b278-939950e9887b {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:24:45.808983 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'code': 200} Nov 16 03:24:45.837314 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:24:46.027400 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee0019b-cbe7-437d-a0dc-35c6f25aebdd req-2c4e5ad5-2310-4af8-821e-572a5a410dff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:46.028895 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0ee0019b-cbe7-437d-a0dc-35c6f25aebdd req-2c4e5ad5-2310-4af8-821e-572a5a410dff service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1098 time: 0.0504284 Nov 16 03:24:46.086975 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0ee0019b-cbe7-437d-a0dc-35c6f25aebdd req-99119c7e-715c-4b09-924c-81f8a6ab1dc1 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507159 Nov 16 03:24:46.123671 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601bb658-3951-4cb7-934f-b697fc6f1ce7 req-37ea68d9-2e55-4dce-841f-57aa353d082b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:46.125320 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-601bb658-3951-4cb7-934f-b697fc6f1ce7 req-37ea68d9-2e55-4dce-841f-57aa353d082b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0567000 Nov 16 03:24:46.186945 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-601bb658-3951-4cb7-934f-b697fc6f1ce7 req-2e7e7ed7-8500-44b7-8455-9c654481f17d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0528862 Nov 16 03:24:47.316329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70413ee2-112f-4d5a-9f3f-25e85d05ecc1 req-50e55b9a-b3f1-457c-baab-a2fdd9b400b2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:47.317814 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70413ee2-112f-4d5a-9f3f-25e85d05ecc1 req-50e55b9a-b3f1-457c-baab-a2fdd9b400b2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0512660 Nov 16 03:24:47.367959 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-70413ee2-112f-4d5a-9f3f-25e85d05ecc1 req-3d18211c-dfa4-4111-9820-bb9d45a756ee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440443 Nov 16 03:24:47.501382 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24068936-7c0b-4c7b-801c-ba840c314bb7 req-fdaac3bf-7b75-41a1-a019-2f1204272cba tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:47.502794 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-24068936-7c0b-4c7b-801c-ba840c314bb7 req-fdaac3bf-7b75-41a1-a019-2f1204272cba tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0641527 Nov 16 03:24:47.511422 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 49872) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:24:47.515861 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Request body: {'floatingip': {'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:24:47.554602 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:48.250803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:48.256404 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:48.357622 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Floating IP 733614a2-3e66-4704-b5d9-e131749f22f6 associated. External IP: 172.27.1.85, port: ec43ffb7-58ab-410e-be98-b04fa6fa5472. Nov 16 03:24:48.464703 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-586b4c11-7b9f-4c09-9671-c9c58240b38d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:48.573365 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:24:48.683431 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:24:48.689423 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:48.694492 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:24:48.705971 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:48.706656 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:24:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:48.717856 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d6377dd2-afda-4b19-a7a3-223992ca40f3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "PUT /v2.0/floatingips/733614a2-3e66-4704-b5d9-e131749f22f6 HTTP/1.1" status: 200 len: 990 time: 1.2052104 Nov 16 03:24:48.718431 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:24:48.720803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6af203f-9417-428a-90e3-c1a61e79d68c" -d '{"events": [{"name": "network-changed", "server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:24:48.761408 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:24:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4d384aa-c435-46cb-aebd-312c3e10aa25 x-openstack-request-id: req-f4d384aa-c435-46cb-aebd-312c3e10aa25 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:24:48.761775 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:24:48.762027 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-f4d384aa-c435-46cb-aebd-312c3e10aa25 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:24:48.762427 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'status': 'completed', 'code': 200} Nov 16 03:24:48.818344 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:48.861290 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-5f5fa908-e14e-44f9-b000-93f131625c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:48.862872 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-5f5fa908-e14e-44f9-b000-93f131625c67 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1098 time: 0.0475700 Nov 16 03:24:48.957692 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-3b6611fc-5e90-4a8b-8dbc-effb969faa9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:48.959175 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-3b6611fc-5e90-4a8b-8dbc-effb969faa9d service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.0865018 Nov 16 03:24:49.031038 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-04de3901-f304-4ac8-b7f6-b41e33af4d0e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 200 len: 998 time: 0.0633984 Nov 16 03:24:49.046053 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '733614a2-3e66-4704-b5d9-e131749f22f6', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'floating_ip_address': '172.27.1.85', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 640, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'mac_address': 'fa:16:3e:d0:78:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:24:35Z', 'updated_at': '2021-11-16T03:24:48Z', 'revision_number': 1, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:49.075857 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:24:49.081032 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-2c825223-e97b-462f-b978-ad6554733dab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:49.082489 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-2c825223-e97b-462f-b978-ad6554733dab service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0446372 Nov 16 03:24:49.084733 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:24:49.085344 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:24:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:49.131188 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-2a983cc5-b526-4529-8738-c57b85e6ea9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:24:49.132688 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-2a983cc5-b526-4529-8738-c57b85e6ea9d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0415499 Nov 16 03:24:49.196262 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:24:49.229747 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-87df4693-efd8-447d-80e3-b4064a7394b6 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879962 Nov 16 03:24:49.322257 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6af203f-9417-428a-90e3-c1a61e79d68c req-29768ee9-d375-45d8-a7c8-36579e404abc service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843666 Nov 16 03:24:49.434881 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '733614a2-3e66-4704-b5d9-e131749f22f6', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'floating_ip_address': '172.27.1.85', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 640, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'mac_address': 'fa:16:3e:d0:78:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:24:35Z', 'updated_at': '2021-11-16T03:24:48Z', 'revision_number': 1, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:24:49.464885 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0660a91-83b8-4123-9eeb-c1f8de3df2a0 None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '733614a2-3e66-4704-b5d9-e131749f22f6', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'floating_ip_address': '172.27.1.85', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 640, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'mac_address': 'fa:16:3e:d0:78:15', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:24:35Z', 'updated_at': '2021-11-16T03:24:48Z', 'revision_number': 1, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:24:49.676302 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73caa71a-2e23-4b7e-9c6b-041bbdb7c3bf None None] New status for floating IP 733614a2-3e66-4704-b5d9-e131749f22f6: ACTIVE {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:24:49.789173 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:51.520734 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:24:51.600905 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:04.139337 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:25:04.640815 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-c40b3a38-660f-460b-b742-4c50aa061092 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0489380 Nov 16 03:25:04.764605 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-d823bae3-9cd9-4fc6-9dc5-4b37889cc67e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:04.766246 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-d823bae3-9cd9-4fc6-9dc5-4b37889cc67e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1098 time: 0.0558853 Nov 16 03:25:04.883805 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-007e837e-2f19-4684-bd0a-939d6896fa5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:04.885329 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-007e837e-2f19-4684-bd0a-939d6896fa5f service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.0918212 Nov 16 03:25:04.956446 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-2e7535cf-8b1c-4c0c-b0ef-ef1420019e1e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 200 len: 1001 time: 0.0616014 Nov 16 03:25:05.006999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-ebf0cabf-a1ea-4b21-9008-d347e886015a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:05.008427 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-ebf0cabf-a1ea-4b21-9008-d347e886015a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0439000 Nov 16 03:25:05.064396 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-3a55c262-96f1-443b-8906-d41058d49999 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:05.065801 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-3a55c262-96f1-443b-8906-d41058d49999 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0490303 Nov 16 03:25:05.168047 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-0cdefdb1-5e4d-46dc-9a3c-b5ef006b5c9a service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0949659 Nov 16 03:25:05.260796 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d20b747e-4ce2-4579-b437-7d2c29bbb367 req-6d9bab97-4256-4735-b512-d52a18ab33ae service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847805 Nov 16 03:25:05.910688 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:14.358857 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-580741a9-8c22-4631-93af-c90fe6e27baf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:18.461973 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-70c705d5-b010-40ad-9211-032b86a64d92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:19.788752 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:21.522648 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:21.604699 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:33.177036 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02d37d0b-f891-4d52-b262-aeea456677fe req-67c4792b-a3dd-4ff1-b27e-371d545d9df6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:33.178602 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-02d37d0b-f891-4d52-b262-aeea456677fe req-67c4792b-a3dd-4ff1-b27e-371d545d9df6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0673034 Nov 16 03:25:33.233362 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-02d37d0b-f891-4d52-b262-aeea456677fe req-4e0601d3-2c76-4e8e-9294-4c57910be1c9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488925 Nov 16 03:25:34.367638 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ded6c0-01bc-4c97-83dd-c456656edc97 req-c532fc1c-6dbb-4131-adc3-3b7bcbf50ca3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:34.369174 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-79ded6c0-01bc-4c97-83dd-c456656edc97 req-c532fc1c-6dbb-4131-adc3-3b7bcbf50ca3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0545168 Nov 16 03:25:34.418748 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-79ded6c0-01bc-4c97-83dd-c456656edc97 req-9b89a944-747b-4727-ace5-52430b0ece1f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434806 Nov 16 03:25:35.546266 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e4bd862-945f-44ee-89dc-5af30a96f7a4 req-319b9f59-b055-4134-82ae-f8c270092997 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:35.547735 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e4bd862-945f-44ee-89dc-5af30a96f7a4 req-319b9f59-b055-4134-82ae-f8c270092997 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0505037 Nov 16 03:25:35.597186 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e4bd862-945f-44ee-89dc-5af30a96f7a4 req-e62c14d8-be1e-48f5-a41f-0fd01e79b832 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432537 Nov 16 03:25:35.922317 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:36.727298 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb1f9a81-73ed-4576-88b6-6eaa623f65dd req-a9f1a11b-a6aa-48fe-a68b-13ec0c0eb34a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:36.728763 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bb1f9a81-73ed-4576-88b6-6eaa623f65dd req-a9f1a11b-a6aa-48fe-a68b-13ec0c0eb34a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0557299 Nov 16 03:25:36.778021 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bb1f9a81-73ed-4576-88b6-6eaa623f65dd req-2fc04157-f2ef-40e2-99b7-39c16784a341 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404379 Nov 16 03:25:37.425550 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-dfe71a8f-7db4-4df4-842c-3ff395b757c0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1557299526&fields=id&tenant_id=f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 267 time: 0.0464733 Nov 16 03:25:37.547599 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-b3636795-6690-442f-bf23-8c91b665ed2e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:37.549171 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-b3636795-6690-442f-bf23-8c91b665ed2e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 812 time: 0.1159611 Nov 16 03:25:37.568054 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-9a7df194-6921-46d0-9bed-3ce793ce81a2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/quotas/f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 375 time: 0.0100515 Nov 16 03:25:37.641115 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-2dbcec8d-7af2-46a5-bb41-f97764f67512 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0661881 Nov 16 03:25:37.758371 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-96816f7d-48f6-46b9-a331-f7b163e8bbd1 service neutron] 10.222.0.31 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0992212 Nov 16 03:25:37.853340 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-a6d331e6-f747-4278-8f48-a1ebcec4492e service neutron] 10.222.0.31 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869226 Nov 16 03:25:37.913323 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96878872-a58d-4914-92f5-603e538553b1 req-f72791e1-7346-4b22-b015-8ada1d2dcd5d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:37.914746 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-96878872-a58d-4914-92f5-603e538553b1 req-f72791e1-7346-4b22-b015-8ada1d2dcd5d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0583391 Nov 16 03:25:37.963956 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-96878872-a58d-4914-92f5-603e538553b1 req-04833867-b41a-42fd-a123-996c8231f903 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430365 Nov 16 03:25:38.154711 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3a258f16-121b-466c-9dc5-a846ee672e1a req-6a31cf37-0630-436d-9489-c6e20bac296a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 210 time: 0.0307021 Nov 16 03:25:39.089225 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15f8ade8-e3fe-4db3-9159-24db43a04714 req-f968b56b-0e51-46d3-8783-4f298992c1c6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:39.091505 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-15f8ade8-e3fe-4db3-9159-24db43a04714 req-f968b56b-0e51-46d3-8783-4f298992c1c6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0522578 Nov 16 03:25:39.142647 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-15f8ade8-e3fe-4db3-9159-24db43a04714 req-5a2ff196-bdf9-4e5b-b751-39d3ee3592c0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441091 Nov 16 03:25:39.252057 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-18024ff1-bf2b-4f48-b416-89b36ddc8753 req-688ba0b2-fe06-4aa6-93db-58242189b1ab tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 210 time: 0.0260737 Nov 16 03:25:39.549605 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-1810ba75-f8d6-408d-8199-221a46dedac2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:39.551026 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-1810ba75-f8d6-408d-8199-221a46dedac2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 812 time: 0.1127574 Nov 16 03:25:39.630846 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-77513102-a8a9-4624-8799-875a53a83123 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f0e656658949487fb898565d34636908 HTTP/1.1" status: 200 len: 380 time: 0.0566547 Nov 16 03:25:39.640130 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'port': {'device_id': '2f69f87d-b041-4f97-9426-81f0e965939c', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'admin_state_up': True, 'tenant_id': 'f0e656658949487fb898565d34636908', 'security_groups': ['b3b2cefa-a732-4c2d-8879-25a8537d518a']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:25:39.757327 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Made reservation on behalf of f0e656658949487fb898565d34636908 for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:25:39.761012 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:39.901471 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Allocated IP 172.20.0.3 (47ea8a48-7e03-48bf-883e-ab437cbcd3a0/5adb8701-919b-407f-b696-94dbe3d5e70a/a66777b3-94bc-425f-97ce-88f5c1d71349) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:25:40.057750 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.096440 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.138288 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:25:40.143662 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:25:40.148359 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:25:40.199074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=a66777b3-94bc-425f-97ce-88f5c1d71349,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:40.215454 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:40.216115 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.228852 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.229251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.229613 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.230183 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.230509 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.230916 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.231221 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.231788 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.232102 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.232531 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.232809 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.233166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:40.250611 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe839078-c280-4871-931a-8927fd396614 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6140881 Nov 16 03:25:40.283613 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Request body: {'port': {'device_id': '2f69f87d-b041-4f97-9426-81f0e965939c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:25:40.299278 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be36ddcf-b4dd-4e41-9b50-7d75ca8b050b req-69ac8c46-54bb-4126-822b-0b77a2554af2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:40.302204 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-be36ddcf-b4dd-4e41-9b50-7d75ca8b050b req-69ac8c46-54bb-4126-822b-0b77a2554af2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0651634 Nov 16 03:25:40.412977 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.442434 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-be36ddcf-b4dd-4e41-9b50-7d75ca8b050b req-d9bd5c86-006b-4594-982f-198c2af4f764 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1214182 Nov 16 03:25:40.480021 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-452e61fd-c1ae-4d97-8f18-224a6888fec8 None None] Provisioning complete for port a66777b3-94bc-425f-97ce-88f5c1d71349 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:25:40.480662 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-452e61fd-c1ae-4d97-8f18-224a6888fec8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.482180 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48a7c0d-2b31-4fb0-9693-2ccdac890652 req-8b5f25b0-84e4-4e4f-8565-87ed5850e32f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:40.483611 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f48a7c0d-2b31-4fb0-9693-2ccdac890652 req-8b5f25b0-84e4-4e4f-8565-87ed5850e32f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 931 time: 0.1308956 Nov 16 03:25:40.519054 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-452e61fd-c1ae-4d97-8f18-224a6888fec8 None None] Port a66777b3-94bc-425f-97ce-88f5c1d71349 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:25:40.608512 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f48a7c0d-2b31-4fb0-9693-2ccdac890652 req-bc73b447-7a29-40a7-a96c-7966af8195bd tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1164227 Nov 16 03:25:40.755738 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a66777b3-94bc-425f-97ce-88f5c1d71349 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:25:40.769277 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.782884 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Transition to ACTIVE for port object a66777b3-94bc-425f-97ce-88f5c1d71349 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:25:40.788475 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:40.841914 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Pushing event updated for resources: {'Port': ['ID=a66777b3-94bc-425f-97ce-88f5c1d71349,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:40.922152 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Attempting to bind port a66777b3-94bc-425f-97ce-88f5c1d71349 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:25:40.922492 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Attempting to bind port a66777b3-94bc-425f-97ce-88f5c1d71349 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:25:40.922821 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Attempting to bind port a66777b3-94bc-425f-97ce-88f5c1d71349 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:25:40.928060 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Port a66777b3-94bc-425f-97ce-88f5c1d71349 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:25:40.928600 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Attempting to bind port a66777b3-94bc-425f-97ce-88f5c1d71349 on network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:25:40.934405 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 25, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:25:40.934741 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Checking segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:25:40.935126 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Bound using segment: {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:25:40.935560 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Bound port: a66777b3-94bc-425f-97ce-88f5c1d71349, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b3df5703-5784-41a7-b817-6be11be04ba5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 304, 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:25:40.935924 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:41.010413 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] For port a66777b3-94bc-425f-97ce-88f5c1d71349, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:25:41.017545 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] For port a66777b3-94bc-425f-97ce-88f5c1d71349, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a66777b3-94bc-425f-97ce-88f5c1d71349,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:25:41.023613 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:41.065582 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.066192 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:41.067609 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] 10.222.0.11 "PUT /v2.0/ports/a66777b3-94bc-425f-97ce-88f5c1d71349 HTTP/1.1" status: 200 len: 1093 time: 0.7886138 Nov 16 03:25:41.068386 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:25:41.070652 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59336b47-fa81-40a8-9279-050c07600ce3" -d '{"events": [{"name": "network-changed", "server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:25:41.090945 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6d7886-e86f-4257-a13c-ad7ca92ccc1d service neutron] Pushing event updated for resources: {'Port': ['ID=a66777b3-94bc-425f-97ce-88f5c1d71349,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:41.110781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:25:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-816b8e9b-13e7-460f-9a30-0ede9aaa8d3b x-openstack-request-id: req-816b8e9b-13e7-460f-9a30-0ede9aaa8d3b {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:25:41.111413 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:25:41.111531 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-816b8e9b-13e7-460f-9a30-0ede9aaa8d3b {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:25:41.111873 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'status': 'completed', 'code': 200} Nov 16 03:25:41.143200 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:25:41.176407 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-a31559e6-1a77-421f-b832-42d192081c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.178167 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-a31559e6-1a77-421f-b832-42d192081c8a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 1096 time: 0.0450950 Nov 16 03:25:41.230355 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-fe1d9932-b104-4902-a3ec-103cbf3462bd service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a66777b3-94bc-425f-97ce-88f5c1d71349 HTTP/1.1" status: 200 len: 217 time: 0.0380011 Nov 16 03:25:41.285656 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-77f0eb47-1154-4866-9e9c-e393cf2fae09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.287427 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-77f0eb47-1154-4866-9e9c-e393cf2fae09 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0494649 Nov 16 03:25:41.342636 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9d142-c703-426e-8013-c84a90015e3f req-816b177e-feae-494d-a1c3-785447293fee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.344111 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-816b177e-feae-494d-a1c3-785447293fee service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0497131 Nov 16 03:25:41.451283 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-e612ad6e-0dec-4ca4-b677-8f7897259aaa service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0966425 Nov 16 03:25:41.573802 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-33d9d142-c703-426e-8013-c84a90015e3f req-e5aaea1c-57ef-4b1f-95f7-52da04b59215 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1145177 Nov 16 03:25:41.589393 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4072b506-82bc-4057-bcd7-3a5c7d5dd30c req-09c89d4c-e10d-4dbc-81f6-9379effba288 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.590917 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4072b506-82bc-4057-bcd7-3a5c7d5dd30c req-09c89d4c-e10d-4dbc-81f6-9379effba288 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0731039 Nov 16 03:25:41.641227 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4072b506-82bc-4057-bcd7-3a5c7d5dd30c req-daec795c-8f5e-40a3-8e69-436e82bf94c0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437555 Nov 16 03:25:41.744732 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59336b47-fa81-40a8-9279-050c07600ce3 req-4b3c55a3-a502-4f2f-970c-e9f40938ea7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.746265 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-4b3c55a3-a502-4f2f-970c-e9f40938ea7f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 1096 time: 0.0842309 Nov 16 03:25:41.760372 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb82bcd1-2408-4ce8-b432-3a21a9da5952 req-56edea57-495f-477d-be50-af0d6171883a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:41.761870 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bb82bcd1-2408-4ce8-b432-3a21a9da5952 req-56edea57-495f-477d-be50-af0d6171883a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0618582 Nov 16 03:25:42.123126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bb82bcd1-2408-4ce8-b432-3a21a9da5952 req-97afe536-5a9e-4f33-99d1-f2f3f6b8f0f9 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3530233 Nov 16 03:25:42.143981 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59336b47-fa81-40a8-9279-050c07600ce3 req-1ac06556-e5a4-4bce-a839-0d026fdc0f17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:42.145475 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-1ac06556-e5a4-4bce-a839-0d026fdc0f17 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.3827422 Nov 16 03:25:42.187122 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-e8aa91dc-c5da-4db0-aef6-ded1f3d0389c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a66777b3-94bc-425f-97ce-88f5c1d71349 HTTP/1.1" status: 200 len: 217 time: 0.0339863 Nov 16 03:25:42.239971 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59336b47-fa81-40a8-9279-050c07600ce3 req-6f24081d-7905-42c8-b099-541e9ee9a152 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:42.241380 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-6f24081d-7905-42c8-b099-541e9ee9a152 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0452335 Nov 16 03:25:42.294655 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59336b47-fa81-40a8-9279-050c07600ce3 req-906cdbec-bba8-4fb9-b17c-850d74d05993 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:42.296122 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-906cdbec-bba8-4fb9-b17c-850d74d05993 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0459638 Nov 16 03:25:42.386173 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-130baff9-31e3-426b-a6ba-99ca0ac1be79 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817010 Nov 16 03:25:42.482175 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-59336b47-fa81-40a8-9279-050c07600ce3 req-8a3675bb-cb43-4943-99ea-9ee3fd3a4636 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887420 Nov 16 03:25:42.778043 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f1e070-a4ba-450f-a08d-2b468ebe86b6 req-e85454a3-4c47-4671-8890-19ff8f0be4a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:42.779526 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b6f1e070-a4ba-450f-a08d-2b468ebe86b6 req-e85454a3-4c47-4671-8890-19ff8f0be4a2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0594230 Nov 16 03:25:42.835475 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b6f1e070-a4ba-450f-a08d-2b468ebe86b6 req-8ea7d64b-b6dc-41f3-bbc2-2e16e10eeaee tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461557 Nov 16 03:25:43.244906 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9cd362-150f-4a74-a49e-31d08855dc79 req-d077ba13-3f09-403c-a3fd-72b22d2f1a3c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:43.246399 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ed9cd362-150f-4a74-a49e-31d08855dc79 req-d077ba13-3f09-403c-a3fd-72b22d2f1a3c tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0497904 Nov 16 03:25:43.297770 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ed9cd362-150f-4a74-a49e-31d08855dc79 req-2ce11ff1-dbd6-4cf3-ab68-b8274ec127d6 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452967 Nov 16 03:25:43.979568 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f1c087-1990-4472-9487-d1d105db7f1e req-ef499919-b2a1-4d4a-a6b4-e543c7d4b69a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:43.981074 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f1c087-1990-4472-9487-d1d105db7f1e req-ef499919-b2a1-4d4a-a6b4-e543c7d4b69a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0596409 Nov 16 03:25:44.030997 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f1c087-1990-4472-9487-d1d105db7f1e req-9b496ead-7527-408a-968d-38b0a134a3a5 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438194 Nov 16 03:25:44.355334 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0619ec17-9af9-4526-8eea-c50c55401c66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:44.419213 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980556f2-d094-47f6-b345-d6721d7586fe req-8afd274c-0589-4c37-b6bc-26183423e7c4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:44.420685 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-980556f2-d094-47f6-b345-d6721d7586fe req-8afd274c-0589-4c37-b6bc-26183423e7c4 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0504212 Nov 16 03:25:44.474195 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-980556f2-d094-47f6-b345-d6721d7586fe req-f64d790c-ad6d-4868-baec-cdbdc9da6113 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449288 Nov 16 03:25:45.295261 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e658acc6-9402-493f-865c-756ecc0c8b7d req-800b5a31-f63b-4ecd-8d7b-46be2f9e4a11 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:45.296791 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e658acc6-9402-493f-865c-756ecc0c8b7d req-800b5a31-f63b-4ecd-8d7b-46be2f9e4a11 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0636580 Nov 16 03:25:45.352723 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e658acc6-9402-493f-865c-756ecc0c8b7d req-c27961fa-338f-4e67-9a33-b500e37de495 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476382 Nov 16 03:25:45.596197 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13430f56-a58c-4eeb-80a6-d912386f8b7a req-ba0914e0-a43f-4b12-88cc-e00304e5160f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:45.598102 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13430f56-a58c-4eeb-80a6-d912386f8b7a req-ba0914e0-a43f-4b12-88cc-e00304e5160f tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0516615 Nov 16 03:25:45.655779 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-13430f56-a58c-4eeb-80a6-d912386f8b7a req-eb98d7e3-da83-4aa7-8d0f-c0f59e8ff23b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512049 Nov 16 03:25:45.803706 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:25:45.904162 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:45.916369 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'mac_address': 'fa:16:3e:d0:78:15', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:25:45.959976 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:45.973905 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id ec43ffb7-58ab-410e-be98-b04fa6fa5472 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:25:45.995707 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:46.000906 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:46.052608 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=6']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:46.060202 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.060557 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.060896 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.061230 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.061607 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.062229 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.062738 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.063239 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.063589 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.063914 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.064243 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.064568 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:25:46.164961 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['ec43ffb7-58ab-410e-be98-b04fa6fa5472'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:25:46.488307 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc09b04b-25e9-46f6-9bcb-7b8f73c2352c req-a4a84ee6-a917-4ba0-af26-4f8f8786b9b7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:46.493957 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc09b04b-25e9-46f6-9bcb-7b8f73c2352c req-a4a84ee6-a917-4ba0-af26-4f8f8786b9b7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 944 time: 0.0588639 Nov 16 03:25:46.551400 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc09b04b-25e9-46f6-9bcb-7b8f73c2352c req-cff3ee93-c1db-4d80-a80c-6f3ce866fe30 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529821 Nov 16 03:25:46.800423 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42dd9218-d7d9-4002-b583-97b529871170 req-8c65b489-7483-4abe-b02f-552c6e688b61 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:46.802120 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-42dd9218-d7d9-4002-b583-97b529871170 req-8c65b489-7483-4abe-b02f-552c6e688b61 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0597363 Nov 16 03:25:46.867982 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-42dd9218-d7d9-4002-b583-97b529871170 req-2ee0285c-ee7b-42f8-b2e3-62bfecafcd59 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542474 Nov 16 03:25:47.701148 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d48a8f0-3477-45c8-8a6b-66732fdd7ec4 req-25162c57-1f86-499e-b869-e199ef8e36db tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:47.702780 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7d48a8f0-3477-45c8-8a6b-66732fdd7ec4 req-25162c57-1f86-499e-b869-e199ef8e36db tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 944 time: 0.0621698 Nov 16 03:25:47.755233 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7d48a8f0-3477-45c8-8a6b-66732fdd7ec4 req-5347a547-72e5-42b6-999f-03695a18c236 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461679 Nov 16 03:25:47.820131 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:25:47.869329 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port ec43ffb7-58ab-410e-be98-b04fa6fa5472 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:25:47.869825 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:47.979392 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:48.000602 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fbc9f4a-4947-4c09-87e6-5c3b48f1c4c6 req-134adb59-d810-402d-9833-a703082c2676 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:48.009229 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5fbc9f4a-4947-4c09-87e6-5c3b48f1c4c6 req-134adb59-d810-402d-9833-a703082c2676 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0677154 Nov 16 03:25:48.012598 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:25:48.017562 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b8b4627-8223-492c-9726-3312b6fef561" -d '{"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-plugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:25:48.034091 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:48.048815 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:48.066577 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:25:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03938066-2b2d-4402-914d-2d83a613cd03 x-openstack-request-id: req-03938066-2b2d-4402-914d-2d83a613cd03 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:25:48.067039 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-plugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:25:48.067768 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-03938066-2b2d-4402-914d-2d83a613cd03 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:25:48.068405 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'code': 200} Nov 16 03:25:48.078552 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5fbc9f4a-4947-4c09-87e6-5c3b48f1c4c6 req-d7be0cdf-b3fd-4f0c-9921-3ddbe1b2c920 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0682316 Nov 16 03:25:48.126705 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=7']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:48.459764 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-f35177f4-ae19-4b14-9677-23eb17281f6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:48.891431 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac45ccf-07ec-4ab4-b72c-5463b667a40b req-a487c03e-107e-4e82-a2d0-d2f4b1089475 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:48.892931 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eac45ccf-07ec-4ab4-b72c-5463b667a40b req-a487c03e-107e-4e82-a2d0-d2f4b1089475 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0513496 Nov 16 03:25:48.950195 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eac45ccf-07ec-4ab4-b72c-5463b667a40b req-57660200-896c-4522-951b-984affee9a82 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487967 Nov 16 03:25:49.208443 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b46fc41-9ddd-487d-a768-f97f9f5cbbdc req-22ebd44e-f0e9-41b1-b74e-23066eb6e3ca tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:49.210887 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8b46fc41-9ddd-487d-a768-f97f9f5cbbdc req-22ebd44e-f0e9-41b1-b74e-23066eb6e3ca tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 943 time: 0.0582881 Nov 16 03:25:49.270587 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8b46fc41-9ddd-487d-a768-f97f9f5cbbdc req-64bc36c7-bce5-413a-81de-9129770926da tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522642 Nov 16 03:25:49.793786 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:49.823082 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a66777b3-94bc-425f-97ce-88f5c1d71349 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:25:49.934429 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a66777b3-94bc-425f-97ce-88f5c1d71349, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a66777b3-94bc-425f-97ce-88f5c1d71349,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:49.947487 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'port_id': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'mac_address': 'fa:16:3e:62:ce:47', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:25:49.993890 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:50.118507 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda2432b-60c3-4104-81d0-977da8591dc5 req-95861d1b-8e15-4e51-aa87-07f6528c4143 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:50.126476 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bda2432b-60c3-4104-81d0-977da8591dc5 req-95861d1b-8e15-4e51-aa87-07f6528c4143 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0754535 Nov 16 03:25:50.146822 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a66777b3-94bc-425f-97ce-88f5c1d71349 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:25:50.170467 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a66777b3-94bc-425f-97ce-88f5c1d71349, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a66777b3-94bc-425f-97ce-88f5c1d71349,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:50.176618 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:50.193828 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bda2432b-60c3-4104-81d0-977da8591dc5 req-74b96967-02b8-40d2-8ed8-94d9ed8b46fe tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0652490 Nov 16 03:25:50.238774 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=a66777b3-94bc-425f-97ce-88f5c1d71349,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:50.422026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cbcfdb-7ffe-457f-8201-699b8bc20457 req-305b8902-abef-4f15-904e-986cfb6e8ced tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:50.425068 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d9cbcfdb-7ffe-457f-8201-699b8bc20457 req-305b8902-abef-4f15-904e-986cfb6e8ced tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 944 time: 0.0744205 Nov 16 03:25:50.487727 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d9cbcfdb-7ffe-457f-8201-699b8bc20457 req-80ee9c60-6b53-46ab-a86d-a4391f970ea0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566292 Nov 16 03:25:50.530451 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['a66777b3-94bc-425f-97ce-88f5c1d71349'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:25:51.326411 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cceec8b0-b0f0-4114-b94f-993e264891c2 req-c9d75f41-91ba-47f8-a1fe-b712d441475c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:51.327979 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cceec8b0-b0f0-4114-b94f-993e264891c2 req-c9d75f41-91ba-47f8-a1fe-b712d441475c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0557196 Nov 16 03:25:51.386609 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cceec8b0-b0f0-4114-b94f-993e264891c2 req-8e02b3ea-1c06-43e7-bb55-ec697e1a0107 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526302 Nov 16 03:25:51.534356 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:51.601983 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:51.608721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-971837a6-3344-48e9-872c-5aa667b57829 req-05dde726-ab33-4d51-abcc-56fc1eabbb1d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:51.617124 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-971837a6-3344-48e9-872c-5aa667b57829 req-05dde726-ab33-4d51-abcc-56fc1eabbb1d tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 944 time: 0.0591557 Nov 16 03:25:51.668915 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-971837a6-3344-48e9-872c-5aa667b57829 req-b716be41-48c0-47d8-a1b8-4e3c3a5afcfc tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505178 Nov 16 03:25:51.841688 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a66777b3-94bc-425f-97ce-88f5c1d71349 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:25:51.901637 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port a66777b3-94bc-425f-97ce-88f5c1d71349 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:25:51.906431 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port a66777b3-94bc-425f-97ce-88f5c1d71349 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:25:51.906795 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:51.993183 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:52.020409 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:25:52.023974 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e08f112d-53d5-40f9-adcf-76d830f30485" -d '{"events": [{"server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "name": "network-vif-plugged", "status": "completed", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:25:52.059047 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a66777b3-94bc-425f-97ce-88f5c1d71349, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a66777b3-94bc-425f-97ce-88f5c1d71349,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:52.065592 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:52.093956 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:25:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9495442c-94be-40b6-b637-32b3af7cba6f x-openstack-request-id: req-9495442c-94be-40b6-b637-32b3af7cba6f {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:25:52.094305 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "name": "network-vif-plugged", "status": "completed", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:25:52.094527 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9495442c-94be-40b6-b637-32b3af7cba6f {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:25:52.094958 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'code': 200} Nov 16 03:25:52.129629 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=a66777b3-94bc-425f-97ce-88f5c1d71349,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:52.406930 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d10bcef-aa48-429d-8c9a-9539596f05c8 req-27e4df0f-0fd0-44cd-8378-0fd7b32bc659 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:52.409477 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d10bcef-aa48-429d-8c9a-9539596f05c8 req-27e4df0f-0fd0-44cd-8378-0fd7b32bc659 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 1098 time: 0.0625272 Nov 16 03:25:52.465853 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d10bcef-aa48-429d-8c9a-9539596f05c8 req-9da865f2-2e91-47c2-8820-0991fb7b421c service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457282 Nov 16 03:25:52.532511 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc37349c-9ebe-400a-b820-d56564445631 req-ca248bfe-35fd-4964-9d80-3412242c3ca2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:52.534932 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc37349c-9ebe-400a-b820-d56564445631 req-ca248bfe-35fd-4964-9d80-3412242c3ca2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0612600 Nov 16 03:25:52.594634 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc37349c-9ebe-400a-b820-d56564445631 req-3c4222d7-5d3f-4ada-9ef5-e93b58d58c07 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495143 Nov 16 03:25:52.797747 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5525eb4-391a-48d1-9d30-e9a015788f49 req-1ebbb12e-e483-48d2-bc46-76134b811eeb tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:52.799300 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d5525eb4-391a-48d1-9d30-e9a015788f49 req-1ebbb12e-e483-48d2-bc46-76134b811eeb tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 945 time: 0.0524735 Nov 16 03:25:52.862990 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d5525eb4-391a-48d1-9d30-e9a015788f49 req-a4d29070-496c-49ce-ae42-90cf3919d77e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557389 Nov 16 03:25:53.778523 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e33d05-ae37-4218-b64c-b7ae9d3bcc70 req-d40b6d1e-1aec-456a-a487-c22c00d5fb19 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:53.780685 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-07e33d05-ae37-4218-b64c-b7ae9d3bcc70 req-d40b6d1e-1aec-456a-a487-c22c00d5fb19 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0827363 Nov 16 03:25:53.868314 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-07e33d05-ae37-4218-b64c-b7ae9d3bcc70 req-68f60cae-8e4c-447f-8269-80909387ee4d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0800126 Nov 16 03:25:54.033579 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c8a9c0-7a34-4328-8548-9eb46c5b8879 req-6073fe11-ac4a-43c6-8dcd-228ccb70f1d6 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:54.035395 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89c8a9c0-7a34-4328-8548-9eb46c5b8879 req-6073fe11-ac4a-43c6-8dcd-228ccb70f1d6 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 945 time: 0.0773277 Nov 16 03:25:54.110369 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89c8a9c0-7a34-4328-8548-9eb46c5b8879 req-c9376c4a-713f-41e7-9346-22a0b50735d1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0635488 Nov 16 03:25:54.283356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ba3c6f-14c9-460a-86dc-22bd12dca4a1 req-7151ad33-017c-4e9c-86fd-e718a18908d0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:54.284905 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89ba3c6f-14c9-460a-86dc-22bd12dca4a1 req-7151ad33-017c-4e9c-86fd-e718a18908d0 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 945 time: 0.0949724 Nov 16 03:25:54.349224 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-89ba3c6f-14c9-460a-86dc-22bd12dca4a1 req-76d4c0a3-0264-49d8-9fce-d562fc001a43 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579207 Nov 16 03:25:54.374807 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50142) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:25:54.605089 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f366b669-e865-4b98-ac3a-a407315f8ff4 tempest-TestVolumeBootPattern-1638411920 tempest-TestVolumeBootPattern-1638411920-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:54.609965 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50148) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:25:54.610156 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-f366b669-e865-4b98-ac3a-a407315f8ff4 tempest-TestVolumeBootPattern-1638411920 tempest-TestVolumeBootPattern-1638411920-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 1093 time: 0.2337472 Nov 16 03:25:54.614816 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'port_id': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'tenant_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address': '172.20.0.3'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:25:54.645314 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:54.753624 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:54.872192 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Allocated IP 172.27.1.5 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/2909a0a2-5d54-4e77-b72d-2772edb1f772) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:25:55.030871 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.051864 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b472fee8-af92-4610-bbab-68ecc9ce162d req-e09ef274-f153-4e24-891a-f57da4d437b0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:55.053667 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b472fee8-af92-4610-bbab-68ecc9ce162d req-e09ef274-f153-4e24-891a-f57da4d437b0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0876460 Nov 16 03:25:55.108586 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.145025 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b472fee8-af92-4610-bbab-68ecc9ce162d req-96fce323-433e-45c7-b4b4-34d3011ac19c tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0850196 Nov 16 03:25:55.160140 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:25:55.167493 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=2909a0a2-5d54-4e77-b72d-2772edb1f772,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:55.173250 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:25:55.175984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:25:55.525253 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.596080 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.756629 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.762306 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.862381 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event updated for resources: {'Port': ['ID=2909a0a2-5d54-4e77-b72d-2772edb1f772,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:25:55.879384 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:55.884420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-d6f0dbc9-ff1e-46b8-aff9-8d891a78bbfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:55.885971 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-d6f0dbc9-ff1e-46b8-aff9-8d891a78bbfc service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1098 time: 0.0938671 Nov 16 03:25:56.051985 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Floating IP 4c2589ff-bedc-491e-9f92-4042030e3da1 associated. External IP: 172.27.1.5, port: a66777b3-94bc-425f-97ce-88f5c1d71349. Nov 16 03:25:56.056991 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-9610cd6f-fe79-40e7-afee-dcd7cda2dda8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:56.058484 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-9610cd6f-fe79-40e7-afee-dcd7cda2dda8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.1425865 Nov 16 03:25:56.191712 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-5bbb7694-0239-4315-a22c-2a41325816e5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 200 len: 1000 time: 0.1032786 Nov 16 03:25:56.336657 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-333d6ac0-8c38-44d7-9480-fa937c71f840 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:56.337997 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-333d6ac0-8c38-44d7-9480-fa937c71f840 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.1369739 Nov 16 03:25:56.403671 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26b95d7-0b16-4fd8-95e2-cc82d861e94b req-b18cce46-7c04-421c-bd69-1b13014b7996 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:56.405152 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b26b95d7-0b16-4fd8-95e2-cc82d861e94b req-b18cce46-7c04-421c-bd69-1b13014b7996 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.1745870 Nov 16 03:25:56.446854 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:25:56.448593 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-8b08a28b-2564-4c86-847d-5352c7f1ddf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:56.450086 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-8b08a28b-2564-4c86-847d-5352c7f1ddf2 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1035311 Nov 16 03:25:56.528996 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b26b95d7-0b16-4fd8-95e2-cc82d861e94b req-d9a09d4f-78a4-4dd5-a3e1-2506080a41b1 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1130080 Nov 16 03:25:56.907255 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-b4ce282d-9bc6-4006-bc0c-ce9da9999711 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4454243 Nov 16 03:25:56.938854 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:25:56.949072 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:25:56.963052 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:25:56.963686 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:25:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:25:56.997308 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:57.040071 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-53f72e1f-a4b8-4f5e-9e37-51edd7d67998 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 994 time: 2.4287243 Nov 16 03:25:57.041934 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:25:57.044183 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3" -d '{"events": [{"name": "network-changed", "server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:25:57.048875 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f96719a7-bba2-4a68-8c1d-45429779d1ec req-7bd58517-a8a5-45c8-98e7-166b70cf271f service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1309142 Nov 16 03:25:57.081676 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:25:57.089858 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:25:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-765f7165-d10a-4944-8a9b-c3c21b6448fd x-openstack-request-id: req-765f7165-d10a-4944-8a9b-c3c21b6448fd {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:25:57.090148 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:25:57.090396 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-765f7165-d10a-4944-8a9b-c3c21b6448fd {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:25:57.090794 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'status': 'completed', 'code': 200} Nov 16 03:25:57.184294 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-a38d7c9e-e8c5-4dd3-b3b7-d428536b79ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:57.185829 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-a38d7c9e-e8c5-4dd3-b3b7-d428536b79ce service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 1098 time: 0.0439172 Nov 16 03:25:57.284135 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-21edab08-906b-43ae-ae6a-7a2993a28572 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:57.285676 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-21edab08-906b-43ae-ae6a-7a2993a28572 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.0911629 Nov 16 03:25:57.311955 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '4c2589ff-bedc-491e-9f92-4042030e3da1', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.5', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 644, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:62:ce:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f69f87d-b041-4f97-9426-81f0e965939c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:25:55Z', 'updated_at': '2021-11-16T03:25:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}, {'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:58Z', 'revision_number': 1, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:25:57.342110 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:25:57.352100 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:25:57.352722 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:25:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:25:57.355992 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-7b80252e-fea9-4543-b1ec-3511fac72258 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a66777b3-94bc-425f-97ce-88f5c1d71349 HTTP/1.1" status: 200 len: 997 time: 0.0628567 Nov 16 03:25:57.419692 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-0687fa25-6d44-478b-8c24-290b6e580617 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:57.421158 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-0687fa25-6d44-478b-8c24-290b6e580617 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0573747 Nov 16 03:25:57.464598 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:25:57.469035 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-96a6df54-11be-4445-b3ed-a9644a014006 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:57.470584 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-96a6df54-11be-4445-b3ed-a9644a014006 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0417051 Nov 16 03:25:57.568869 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-04d25f5c-b494-4b89-9fa6-75732ece95d8 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894818 Nov 16 03:25:57.695199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a17ae6a-6f97-488d-bc26-fbbd14bfd641 req-fa3a4339-43f0-4ba1-9224-094865648219 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:57.696599 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9a17ae6a-6f97-488d-bc26-fbbd14bfd641 req-fa3a4339-43f0-4ba1-9224-094865648219 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0745077 Nov 16 03:25:57.701163 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '4c2589ff-bedc-491e-9f92-4042030e3da1', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.5', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 644, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:62:ce:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f69f87d-b041-4f97-9426-81f0e965939c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:25:55Z', 'updated_at': '2021-11-16T03:25:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}, {'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:58Z', 'revision_number': 1, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:25:57.702078 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-41dab6e3-5120-4cbf-a11d-6fc9d15ff0e3 req-49478a14-cb52-4e61-95f3-7271ac53edd9 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257532 Nov 16 03:25:57.732815 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3ed337-4c65-4e72-821f-324f1bcce0a3 None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '4c2589ff-bedc-491e-9f92-4042030e3da1', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.5', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 644, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:62:ce:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f69f87d-b041-4f97-9426-81f0e965939c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:25:55Z', 'updated_at': '2021-11-16T03:25:55Z', 'revision_number': 0, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}, {'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:58Z', 'revision_number': 1, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:25:57.747126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9a17ae6a-6f97-488d-bc26-fbbd14bfd641 req-8e650ba5-c26d-466c-a3f7-80468b2bc3e6 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433972 Nov 16 03:25:57.923282 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f982c4e8-5f47-438e-897c-802a9b0bbff0 None None] New status for floating IP 4c2589ff-bedc-491e-9f92-4042030e3da1: ACTIVE {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:25:58.882561 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc2751bc-4369-4338-a7d7-5eb0a18cee9c req-3874acbb-b926-4980-8cf8-e19415f12169 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:25:58.885064 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dc2751bc-4369-4338-a7d7-5eb0a18cee9c req-3874acbb-b926-4980-8cf8-e19415f12169 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 945 time: 0.0550392 Nov 16 03:25:58.934423 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dc2751bc-4369-4338-a7d7-5eb0a18cee9c req-98ce293f-8802-4a09-b032-87fc49665afe tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433102 Nov 16 03:25:59.849751 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:25:59.930450 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:25:59.964358 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:25:59.966640 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4df753b8-089c-4feb-ba09-721a37ea562d" -d '{"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-unplugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:25:59.980607 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:25:59.989410 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:00.014099 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 16 Nov 2021 03:25:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c17f2ee-c873-49e9-90e0-af4526ee8cb5 x-openstack-request-id: req-6c17f2ee-c873-49e9-90e0-af4526ee8cb5 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:26:00.014391 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-unplugged", "status": "failed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "code": 422}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:26:00.014642 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-6c17f2ee-c873-49e9-90e0-af4526ee8cb5 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:26:00.015031 dv-cinder-818037-1-iscsi neutron-server[101900]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'code': 422} returned with failed status Nov 16 03:26:00.045038 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=8']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:26:00.063621 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c358196b-6865-47e6-b978-944a27d7552b req-89afb856-e2e5-450b-87e5-e1f2fb603cda tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:00.065105 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c358196b-6865-47e6-b978-944a27d7552b req-89afb856-e2e5-450b-87e5-e1f2fb603cda tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0490201 Nov 16 03:26:00.114716 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c358196b-6865-47e6-b978-944a27d7552b req-3d91b885-17f4-4d05-8659-beae2b8dd630 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409727 Nov 16 03:26:00.977136 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-ba6b85eb-5aaf-44a3-89ee-2da3c3a8b3f5 req-af647b2f-b755-41dd-8efd-021c01833881 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:26:00.978345 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ba6b85eb-5aaf-44a3-89ee-2da3c3a8b3f5 req-af647b2f-b755-41dd-8efd-021c01833881 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0076180 Nov 16 03:26:02.176363 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b5e7bd-8c3d-4dd7-a042-251053aef627 req-380f71d2-56d9-4752-bee1-0a3e97670a14 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:02.177869 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d3b5e7bd-8c3d-4dd7-a042-251053aef627 req-380f71d2-56d9-4752-bee1-0a3e97670a14 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0772929 Nov 16 03:26:02.216245 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e07df4-28e1-48bc-b1fc-63e6cc9f97b5 req-319d9f08-a562-430f-b033-9e8642ad226d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:02.217795 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-69e07df4-28e1-48bc-b1fc-63e6cc9f97b5 req-319d9f08-a562-430f-b033-9e8642ad226d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0776169 Nov 16 03:26:02.255762 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d3b5e7bd-8c3d-4dd7-a042-251053aef627 req-f599604d-1ee3-433a-974e-5949227f327a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0713630 Nov 16 03:26:02.286022 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-69e07df4-28e1-48bc-b1fc-63e6cc9f97b5 req-78170639-9171-4cab-94dc-f70b281f5c8b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0625036 Nov 16 03:26:02.380647 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50226) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:26:02.478312 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-2b8bdb63-9f1c-4559-aa4b-18d4fbbc816b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0964715 Nov 16 03:26:02.487470 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-c80965de-830b-4b52-a408-9fb1c7493350 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:26:02.488423 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-c80965de-830b-4b52-a408-9fb1c7493350 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050890 Nov 16 03:26:03.405166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec6ec8a-e55d-40e2-8fd6-3b23bdaa731f req-54f601de-6688-47bb-ba8d-45487c9729b1 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.406706 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5ec6ec8a-e55d-40e2-8fd6-3b23bdaa731f req-54f601de-6688-47bb-ba8d-45487c9729b1 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0800593 Nov 16 03:26:03.445473 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eefe48d-47ce-417f-a185-e09668dd110d req-54ab9128-78b4-45fa-8f81-356df264e94b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.447516 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7eefe48d-47ce-417f-a185-e09668dd110d req-54ab9128-78b4-45fa-8f81-356df264e94b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0839407 Nov 16 03:26:03.542223 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5ec6ec8a-e55d-40e2-8fd6-3b23bdaa731f req-22337f3b-36fa-42cb-afb3-c3603c836b76 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1277845 Nov 16 03:26:03.581947 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7eefe48d-47ce-417f-a185-e09668dd110d req-09612247-2b96-465a-af11-e55e48696a31 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1273415 Nov 16 03:26:03.584646 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-3bbce69e-d499-4ee9-9ad5-2b31ebdf304d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.586064 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-3bbce69e-d499-4ee9-9ad5-2b31ebdf304d service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7&tenant_id=2852179c69834bda8a41052f2d958cd4 HTTP/1.1" status: 200 len: 1096 time: 0.1177602 Nov 16 03:26:03.662398 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-45583b43-e9c7-4776-a4c6-5b76ffb3fc37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.663950 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-45583b43-e9c7-4776-a4c6-5b76ffb3fc37 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2852179c69834bda8a41052f2d958cd4&device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1096 time: 0.0421154 Nov 16 03:26:03.761536 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-ede5d966-ae46-4741-b842-05443a6f0063 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.762994 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-ede5d966-ae46-4741-b842-05443a6f0063 service neutron] 10.222.0.11 "GET /v2.0/networks?id=9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 200 len: 917 time: 0.0918710 Nov 16 03:26:03.831617 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-e83ded54-d3ac-405b-9e44-2e5fb7199880 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 200 len: 998 time: 0.0599344 Nov 16 03:26:03.880422 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-788b7b5e-b650-45d0-9b80-c0fad2935220 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.881887 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-788b7b5e-b650-45d0-9b80-c0fad2935220 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 200 len: 855 time: 0.0426295 Nov 16 03:26:03.894609 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:26:03.953103 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-66e85a65-f6a7-444c-9cf2-110e138c5ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:03.954761 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-66e85a65-f6a7-444c-9cf2-110e138c5ebd service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=9af16874-689f-4be5-82a5-a21abe98a824&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0479064 Nov 16 03:26:04.070276 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-77e26458-83be-42bf-8dec-3744f5e13834 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0935788 Nov 16 03:26:04.169766 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f21f82de-1257-4ed9-9c1d-b8b132d1a1c8 req-2add89aa-9262-46ac-b5c0-429c0528f982 service neutron] 10.222.0.11 "GET /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916002 Nov 16 03:26:04.683461 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302a0dbd-f607-4ded-b37c-c9651024773f req-e8b1a2a1-8253-477f-92bc-2e59d7cf2239 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:04.685158 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-302a0dbd-f607-4ded-b37c-c9651024773f req-e8b1a2a1-8253-477f-92bc-2e59d7cf2239 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0657547 Nov 16 03:26:04.766507 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-302a0dbd-f607-4ded-b37c-c9651024773f req-bff17f70-e50c-4c56-9724-3de5c3b18fea tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747263 Nov 16 03:26:04.794074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75d28d8-3e7c-4fc4-b0e1-20b9e013a6ed req-b915b145-a07a-4a64-98da-80694bc67d69 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:04.797026 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c75d28d8-3e7c-4fc4-b0e1-20b9e013a6ed req-b915b145-a07a-4a64-98da-80694bc67d69 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0804453 Nov 16 03:26:04.877751 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c75d28d8-3e7c-4fc4-b0e1-20b9e013a6ed req-d059fd51-a812-4542-83af-86014cdf943e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600581 Nov 16 03:26:05.914155 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:05.914760 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42481197-8bd4-48c8-b6d4-2672055e1744 req-8d7f9544-1b02-412d-bf12-4b3fc8517c87 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:05.916347 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-42481197-8bd4-48c8-b6d4-2672055e1744 req-8d7f9544-1b02-412d-bf12-4b3fc8517c87 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0546157 Nov 16 03:26:05.992045 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-42481197-8bd4-48c8-b6d4-2672055e1744 req-ec38d2b0-c8d3-44d1-bfae-0b4140d11ca6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0639553 Nov 16 03:26:06.032354 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b44b75d-c1c5-4648-9e9e-e7930276c34b req-d958b09b-2f54-4c83-bc07-cb667972868b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:06.034380 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b44b75d-c1c5-4648-9e9e-e7930276c34b req-d958b09b-2f54-4c83-bc07-cb667972868b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0619588 Nov 16 03:26:06.088468 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b44b75d-c1c5-4648-9e9e-e7930276c34b req-4ff06642-5514-4d18-9122-c2b6c3abadfc tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480952 Nov 16 03:26:07.119742 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2fc6b80-afe5-46ab-89e6-af1ed9637f1a req-40773882-67ca-411d-89cd-d67de6cf74cf tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:07.121801 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c2fc6b80-afe5-46ab-89e6-af1ed9637f1a req-40773882-67ca-411d-89cd-d67de6cf74cf tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0607982 Nov 16 03:26:07.210216 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c2fc6b80-afe5-46ab-89e6-af1ed9637f1a req-37483126-6074-41f6-86a8-6c1c6c7e93e1 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0824411 Nov 16 03:26:07.231778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5e48bf-16fb-4992-aee8-f061fc397dbb req-c9119c15-7b70-41e6-bd5c-a0c09d83b8a7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:07.234159 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7e5e48bf-16fb-4992-aee8-f061fc397dbb req-c9119c15-7b70-41e6-bd5c-a0c09d83b8a7 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0680356 Nov 16 03:26:07.304425 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7e5e48bf-16fb-4992-aee8-f061fc397dbb req-2281c8ac-bb6f-42fb-be40-709cb9c08065 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0580502 Nov 16 03:26:08.342052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4057592f-fbad-43d6-b665-8eda12133937 req-66cd1eeb-6865-4cdb-9730-987b48eb706e tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:08.346748 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4057592f-fbad-43d6-b665-8eda12133937 req-66cd1eeb-6865-4cdb-9730-987b48eb706e tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0581422 Nov 16 03:26:08.398931 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4057592f-fbad-43d6-b665-8eda12133937 req-9f3bca7b-d9a0-49b7-9cec-ad0ac14a51f8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487804 Nov 16 03:26:08.457468 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e720c60-db99-4640-ba63-737eb20597c4 req-d38bd025-6d8b-4f8e-bd0c-9615019a76e3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:08.460109 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7e720c60-db99-4640-ba63-737eb20597c4 req-d38bd025-6d8b-4f8e-bd0c-9615019a76e3 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0574095 Nov 16 03:26:08.515905 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7e720c60-db99-4640-ba63-737eb20597c4 req-254a5d30-1b47-46bb-bbba-77cb9bb9f660 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517790 Nov 16 03:26:09.526817 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a9ba89-e017-4300-a6a7-47a83f51db70 req-93d2374f-5049-4bca-b499-afc3e6f5e0b7 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:09.528327 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-32a9ba89-e017-4300-a6a7-47a83f51db70 req-93d2374f-5049-4bca-b499-afc3e6f5e0b7 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0568256 Nov 16 03:26:09.580426 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-32a9ba89-e017-4300-a6a7-47a83f51db70 req-c5c8d6b5-49dc-4527-930f-c08fafc93582 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455923 Nov 16 03:26:09.644379 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dc279e-66db-4d40-b79e-8985acfb4054 req-778f018d-2f15-42de-bede-6519c5e5246a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:09.645839 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c8dc279e-66db-4d40-b79e-8985acfb4054 req-778f018d-2f15-42de-bede-6519c5e5246a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0583227 Nov 16 03:26:09.695945 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c8dc279e-66db-4d40-b79e-8985acfb4054 req-5dfc7879-db22-4b09-91b4-ca1669f5554a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437152 Nov 16 03:26:10.700880 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2477dd55-9ecc-4aeb-9efc-f41b14b4d02d req-7b9ad58d-42bf-49fa-b0c4-7a2a2ed8f584 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:10.702716 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2477dd55-9ecc-4aeb-9efc-f41b14b4d02d req-7b9ad58d-42bf-49fa-b0c4-7a2a2ed8f584 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0537062 Nov 16 03:26:10.755535 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2477dd55-9ecc-4aeb-9efc-f41b14b4d02d req-256376e6-f0ea-42fd-bb9a-202e51ad5b69 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463960 Nov 16 03:26:10.821982 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfdea778-d4b8-4224-aac4-6b1950b3f612 req-5c31930f-dbda-43e4-9169-20f915e15ae4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:10.823818 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cfdea778-d4b8-4224-aac4-6b1950b3f612 req-5c31930f-dbda-43e4-9169-20f915e15ae4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0518391 Nov 16 03:26:10.885477 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cfdea778-d4b8-4224-aac4-6b1950b3f612 req-c49988a9-e1f4-48af-a6ff-75dfe85c200f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489929 Nov 16 03:26:11.880349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e568d1c6-aad4-4db1-9fab-70dc8097d630 req-51e07f1c-7730-4607-bfed-af8f4e2f0642 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:11.881959 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e568d1c6-aad4-4db1-9fab-70dc8097d630 req-51e07f1c-7730-4607-bfed-af8f4e2f0642 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0533671 Nov 16 03:26:11.937956 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e568d1c6-aad4-4db1-9fab-70dc8097d630 req-8e729f98-71c8-4b3b-9160-9bc9982a8b32 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499043 Nov 16 03:26:12.021535 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3e1767-5742-4e6a-912b-37611f95c5ba req-99322069-cd2b-45e7-bd4e-03c816d98f81 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:12.023057 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3d3e1767-5742-4e6a-912b-37611f95c5ba req-99322069-cd2b-45e7-bd4e-03c816d98f81 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0549860 Nov 16 03:26:12.078862 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3d3e1767-5742-4e6a-912b-37611f95c5ba req-2e4f43b0-81bd-48cf-91b2-f34addb5d311 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496645 Nov 16 03:26:13.098451 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b62094-6e6b-4dd5-b3d7-cf4c6f2bf8cc req-9e1252a5-2c21-49b4-8a1a-1a8acf79f1c6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:13.099838 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-66b62094-6e6b-4dd5-b3d7-cf4c6f2bf8cc req-9e1252a5-2c21-49b4-8a1a-1a8acf79f1c6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0519812 Nov 16 03:26:13.174142 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-66b62094-6e6b-4dd5-b3d7-cf4c6f2bf8cc req-02ca70f7-73cd-4fe0-9038-24545660ee8e tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680354 Nov 16 03:26:13.233087 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5288e457-43a3-4379-a5d9-86ef6190356a req-bbf77699-92e7-4ee2-8c5e-d349998bd466 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:13.234599 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5288e457-43a3-4379-a5d9-86ef6190356a req-bbf77699-92e7-4ee2-8c5e-d349998bd466 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0576165 Nov 16 03:26:13.288639 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5288e457-43a3-4379-a5d9-86ef6190356a req-0657d671-6db1-4e89-b77a-6b3c95112a8a tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477819 Nov 16 03:26:14.304086 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128141c-f962-451b-9156-2d8124f8f089 req-dcea5af5-416a-480a-ac5e-451bcdbca2f8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:14.305748 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5128141c-f962-451b-9156-2d8124f8f089 req-dcea5af5-416a-480a-ac5e-451bcdbca2f8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0568526 Nov 16 03:26:14.364755 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5128141c-f962-451b-9156-2d8124f8f089 req-ba453956-7ba3-4863-8e2a-f20dc685e97c tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522256 Nov 16 03:26:14.376820 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-959cb30c-56a6-467a-80fd-e64c75b05ef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:14.458786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c750078d-4add-4edb-b372-d69513751dda req-6e3b93a2-db3e-4cca-b1ba-043f4658f43e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:14.460897 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c750078d-4add-4edb-b372-d69513751dda req-6e3b93a2-db3e-4cca-b1ba-043f4658f43e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0523555 Nov 16 03:26:14.519025 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c750078d-4add-4edb-b372-d69513751dda req-23286044-591d-4fa6-a050-df94593a68f2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526543 Nov 16 03:26:15.495656 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0568a9-d321-4f03-a10b-e611a32459ca req-222b3f1f-b5b4-420a-9b68-bca73dbc2ba8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:15.497198 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9f0568a9-d321-4f03-a10b-e611a32459ca req-222b3f1f-b5b4-420a-9b68-bca73dbc2ba8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0535960 Nov 16 03:26:15.550555 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9f0568a9-d321-4f03-a10b-e611a32459ca req-de90a13d-216b-4074-a893-1a084a6b285b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472341 Nov 16 03:26:15.657576 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4fabb24-6a56-4afb-bd00-ed78e4ff1373 req-31a92616-3b5e-4bbd-9ef8-5a2a5c3750ea tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:15.659353 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b4fabb24-6a56-4afb-bd00-ed78e4ff1373 req-31a92616-3b5e-4bbd-9ef8-5a2a5c3750ea tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0531094 Nov 16 03:26:15.709831 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b4fabb24-6a56-4afb-bd00-ed78e4ff1373 req-20210cbc-5008-4106-b002-a298387d961e tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443680 Nov 16 03:26:16.680338 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6a69ea-50dc-4fb1-89eb-5e96b8427703 req-7afb74e0-4708-4e43-bffb-ead9f3e5932d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:16.681895 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2c6a69ea-50dc-4fb1-89eb-5e96b8427703 req-7afb74e0-4708-4e43-bffb-ead9f3e5932d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0518093 Nov 16 03:26:16.734911 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2c6a69ea-50dc-4fb1-89eb-5e96b8427703 req-ba4df1c6-c8f6-4673-8231-c8e20aafd40e tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469475 Nov 16 03:26:16.848610 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82dcb93-deea-4a14-8804-eb07cbd85f3d req-6f708bf8-6bb1-4e0d-a292-a9dbc2b05d99 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:16.850053 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e82dcb93-deea-4a14-8804-eb07cbd85f3d req-6f708bf8-6bb1-4e0d-a292-a9dbc2b05d99 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0552175 Nov 16 03:26:16.901579 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e82dcb93-deea-4a14-8804-eb07cbd85f3d req-0906e5f0-b480-4a76-8707-b269410c242b tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453711 Nov 16 03:26:16.978757 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-d073503f-aa42-4795-b69b-15e8698ee42e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:16.980253 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-d073503f-aa42-4795-b69b-15e8698ee42e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1099 time: 0.0500927 Nov 16 03:26:17.113358 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-12779c71-4e38-45c2-91df-1e8d3dee80ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.114838 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-12779c71-4e38-45c2-91df-1e8d3dee80ba service neutron] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 909 time: 0.0903995 Nov 16 03:26:17.196591 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-7b38cbf3-697b-42b4-8c0e-5261df10eaa7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 1000 time: 0.0712664 Nov 16 03:26:17.252598 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-8680f8b3-eb6e-42d5-a1f6-ed84e8931b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.254153 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-8680f8b3-eb6e-42d5-a1f6-ed84e8931b44 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.0500953 Nov 16 03:26:17.304357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-2534c3df-f98d-4aea-883b-f5b360c22680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.305865 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-2534c3df-f98d-4aea-883b-f5b360c22680 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439751 Nov 16 03:26:17.399267 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-7ef21f7e-c74a-493c-9f0c-1af2dbee554a service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854456 Nov 16 03:26:17.509958 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-65453d9f-a7ae-41ea-8d3d-3518efbcdf05 req-45581819-0a6f-4678-97c4-420579499e12 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931668 Nov 16 03:26:17.637347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-a19ca728-f7d5-4075-9a4b-a146dbfd742d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.639659 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-a19ca728-f7d5-4075-9a4b-a146dbfd742d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1099 time: 0.0446992 Nov 16 03:26:17.758125 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-d9460375-7786-45f7-911e-e01d959b75ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.760006 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-d9460375-7786-45f7-911e-e01d959b75ae service neutron] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 909 time: 0.0983257 Nov 16 03:26:17.854842 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-66aa776b-5f37-4d6d-a397-3d012f31a6f6 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 1000 time: 0.0846930 Nov 16 03:26:17.881778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950411b7-d54a-4ead-a0ed-6434274e6bb9 req-51dd960b-f37c-4be4-b838-72c6b8b055db tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.883306 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-950411b7-d54a-4ead-a0ed-6434274e6bb9 req-51dd960b-f37c-4be4-b838-72c6b8b055db tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0711699 Nov 16 03:26:17.937978 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-fa78c5e7-d592-456c-ac03-32f154973ac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:17.939455 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-fa78c5e7-d592-456c-ac03-32f154973ac6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.0734732 Nov 16 03:26:17.997785 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-950411b7-d54a-4ead-a0ed-6434274e6bb9 req-b0fa0d7a-0072-48af-87d6-9b2f272749a8 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0930445 Nov 16 03:26:18.030732 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-f0b58193-dbc1-4f2b-a54e-709f25d5cd17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:18.032198 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-f0b58193-dbc1-4f2b-a54e-709f25d5cd17 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0827935 Nov 16 03:26:18.047270 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6090d0de-aa26-40b8-8637-a3b3b494a6be req-f2f3acd6-1ae0-4417-8f44-e59d9e7ec6e9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:18.048734 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6090d0de-aa26-40b8-8637-a3b3b494a6be req-f2f3acd6-1ae0-4417-8f44-e59d9e7ec6e9 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0661433 Nov 16 03:26:18.143848 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:26:18.148348 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6090d0de-aa26-40b8-8637-a3b3b494a6be req-c0542014-2a26-4501-9c56-d066d1e43852 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0913994 Nov 16 03:26:18.172069 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-d5a06814-0dee-4983-9ae7-ca20218e477c service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1223774 Nov 16 03:26:18.271697 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fb64951d-f59e-4a2e-91d6-0098cc2559b7 req-63cf5da0-8171-40a4-8858-455f6e30a17a service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901682 Nov 16 03:26:18.459318 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-361ac6ea-4b2a-4e34-9928-dfd748f76ae1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:19.127006 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04863019-c9c2-416d-b7da-0a5a2e74c75b req-9e9c2fc4-016a-4607-a06e-3be14a4c06fb tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:19.128422 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-04863019-c9c2-416d-b7da-0a5a2e74c75b req-9e9c2fc4-016a-4607-a06e-3be14a4c06fb tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0558209 Nov 16 03:26:19.182570 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-04863019-c9c2-416d-b7da-0a5a2e74c75b req-153d0a9d-3ff2-4c3f-8a6b-5ecccd727782 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472829 Nov 16 03:26:19.273122 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-644673f5-8b23-4252-bf9a-74e5e741b458 req-a5f43b10-47b7-4288-b2a6-2db2af419c1d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:19.274612 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-644673f5-8b23-4252-bf9a-74e5e741b458 req-a5f43b10-47b7-4288-b2a6-2db2af419c1d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 943 time: 0.0499008 Nov 16 03:26:19.327503 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-644673f5-8b23-4252-bf9a-74e5e741b458 req-4e78ee5b-cb68-4f7d-ab56-57171f97cbd2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468802 Nov 16 03:26:19.794098 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:20.072684 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:26:20.307241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d76db2-c997-475a-bb1b-69c5fff117b6 req-0f3aa5b1-7196-4fcc-adea-f3dea0d94233 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:20.308998 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b0d76db2-c997-475a-bb1b-69c5fff117b6 req-0f3aa5b1-7196-4fcc-adea-f3dea0d94233 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0540445 Nov 16 03:26:20.310881 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:20.322684 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'port_id': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'mac_address': 'fa:16:3e:d0:78:15', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:26:20.366331 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b0d76db2-c997-475a-bb1b-69c5fff117b6 req-45c76c4b-5d61-479b-8818-c192bda487df tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509970 Nov 16 03:26:20.369197 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:20.387865 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec43ffb7-58ab-410e-be98-b04fa6fa5472 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:26:20.410206 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:20.429086 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:20.510894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74237fcd-6d95-46a8-a0ea-57609b2e3830 req-ffc848f1-bb5b-4de5-974e-8e8804888a26 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:20.518017 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74237fcd-6d95-46a8-a0ea-57609b2e3830 req-ffc848f1-bb5b-4de5-974e-8e8804888a26 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 944 time: 0.0720356 Nov 16 03:26:20.526563 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=9']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:26:20.571554 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74237fcd-6d95-46a8-a0ea-57609b2e3830 req-7114b8ba-9d52-438e-a404-c92620186262 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507982 Nov 16 03:26:20.787501 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['ec43ffb7-58ab-410e-be98-b04fa6fa5472'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:26:21.506907 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0065878-f258-429b-8c32-ab409e4e5132 req-b2c8eb79-eafc-4ae6-b849-e894398e4cb1 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:21.508453 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f0065878-f258-429b-8c32-ab409e4e5132 req-b2c8eb79-eafc-4ae6-b849-e894398e4cb1 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0603857 Nov 16 03:26:21.526946 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:21.563574 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f0065878-f258-429b-8c32-ab409e4e5132 req-828e0b0c-5fdf-47e9-9900-cabc91db90cf tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483699 Nov 16 03:26:21.597385 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:21.703809 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8081793-8283-4de4-bf63-db062d7b749c req-950cf02c-3df1-4a4b-846b-cbedb0ed17f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:21.705354 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e8081793-8283-4de4-bf63-db062d7b749c req-950cf02c-3df1-4a4b-846b-cbedb0ed17f4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 944 time: 0.0532475 Nov 16 03:26:21.757038 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-c67c8a22-9577-4323-9cde-2a946eed31a0 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0406637 Nov 16 03:26:21.781764 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e8081793-8283-4de4-bf63-db062d7b749c req-94959f1d-73b3-463e-85ce-345636f915f0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0673394 Nov 16 03:26:21.805256 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef909a4c-b702-43de-9dbe-c2de4d28b1d0 req-9d6b6653-e7fb-43d0-8ce3-65e7960e920a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:21.807072 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef909a4c-b702-43de-9dbe-c2de4d28b1d0 req-9d6b6653-e7fb-43d0-8ce3-65e7960e920a tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0659633 Nov 16 03:26:21.861955 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ef909a4c-b702-43de-9dbe-c2de4d28b1d0 req-600517ab-8708-4783-b540-ebaee3398d71 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486028 Nov 16 03:26:22.083576 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:26:22.136485 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port ec43ffb7-58ab-410e-be98-b04fa6fa5472 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:26:22.136846 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:22.219267 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:22.243504 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:26:22.245801 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3a7fed2-401d-4443-a72f-211bd67576fa" -d '{"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-plugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:26:22.258770 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:22.265121 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:22.265998 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:26:22.308655 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:26:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-355551c5-cc0f-44c9-88fa-7ed20255a8e8 x-openstack-request-id: req-355551c5-cc0f-44c9-88fa-7ed20255a8e8 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:26:22.308962 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-plugged", "status": "completed", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:26:22.309212 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-355551c5-cc0f-44c9-88fa-7ed20255a8e8 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:26:22.309615 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'code': 200} Nov 16 03:26:22.348144 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=10']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:26:22.394337 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:22.428250 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:22.432925 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:22.484466 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=6']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:26:22.544356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f077de2-ba08-4794-bd12-777393afa124 req-69d28c98-4a91-41a8-ac58-8c01c8b6dc20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:22.545792 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1f077de2-ba08-4794-bd12-777393afa124 req-69d28c98-4a91-41a8-ac58-8c01c8b6dc20 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 1099 time: 0.0455899 Nov 16 03:26:22.594643 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1f077de2-ba08-4794-bd12-777393afa124 req-e441e0fb-f8db-40f1-9507-97d642af6a05 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407548 Nov 16 03:26:22.914232 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771b27b3-9b1f-4b6c-bb65-c1c1c8d7ed42 req-a0f2ab7b-57ab-40af-ac87-36e04a1ce45d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:22.915856 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-771b27b3-9b1f-4b6c-bb65-c1c1c8d7ed42 req-a0f2ab7b-57ab-40af-ac87-36e04a1ce45d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 946 time: 0.0558071 Nov 16 03:26:23.012888 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-771b27b3-9b1f-4b6c-bb65-c1c1c8d7ed42 req-d3e2479a-5cc6-440c-958a-984a6934ebcd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0910568 Nov 16 03:26:23.026491 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84cfc496-8f7d-477f-8197-ba97272f7e26 req-913a9396-f597-4f71-ab89-251fcf9009dc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:23.040175 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-84cfc496-8f7d-477f-8197-ba97272f7e26 req-913a9396-f597-4f71-ab89-251fcf9009dc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0927794 Nov 16 03:26:23.080959 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-84cfc496-8f7d-477f-8197-ba97272f7e26 req-778b7a4a-1433-4293-a638-c8d2c589f560 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460656 Nov 16 03:26:23.533277 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-a36bc374-1354-4373-b2bb-f7ea7546baa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:23.534910 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-a36bc374-1354-4373-b2bb-f7ea7546baa0 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18&tenant_id=2ea0808579e44cdcaeba4109bc12863b HTTP/1.1" status: 200 len: 1097 time: 0.0509827 Nov 16 03:26:23.621446 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-f93e1a8e-13f7-4a90-9184-4421903311f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:23.622965 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-f93e1a8e-13f7-4a90-9184-4421903311f9 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1097 time: 0.0443141 Nov 16 03:26:24.004696 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-3c6c522b-9b9a-432e-801c-09dd983631ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:24.006390 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-3c6c522b-9b9a-432e-801c-09dd983631ca service neutron] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 909 time: 0.3706758 Nov 16 03:26:24.080150 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-605a2204-b4e6-46d6-98ed-f53ed9d22369 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 998 time: 0.0659781 Nov 16 03:26:24.191549 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-90896842-fad0-4642-ad40-68328401fd24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:24.193334 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-90896842-fad0-4642-ad40-68328401fd24 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.1058581 Nov 16 03:26:24.210488 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173e1006-531e-485f-8f4c-b08ca3b26ddb req-155384b4-8f7d-473e-b6b4-b3df3c9982a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:24.211943 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-173e1006-531e-485f-8f4c-b08ca3b26ddb req-155384b4-8f7d-473e-b6b4-b3df3c9982a4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 946 time: 0.1154234 Nov 16 03:26:24.264378 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f62841-9d78-43e9-839e-5dbc5df17504 req-83c9b676-d8fd-4a13-a437-0aba6636d1c2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:24.265843 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b1f62841-9d78-43e9-839e-5dbc5df17504 req-83c9b676-d8fd-4a13-a437-0aba6636d1c2 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.1096246 Nov 16 03:26:24.311374 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:26:24.313872 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5627127-afd8-48f5-a1e2-87a900d3c2d6" -d '{"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-unplugged", "status": "completed", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:26:24.318857 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-173e1006-531e-485f-8f4c-b08ca3b26ddb req-c144a7e2-eba1-4788-8989-aeead3bc5444 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0986598 Nov 16 03:26:24.323164 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-ecbd6c00-2a73-4df9-b49e-c2d2c7adc81b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:24.324643 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-ecbd6c00-2a73-4df9-b49e-c2d2c7adc81b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1226809 Nov 16 03:26:24.366437 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 16 Nov 2021 03:26:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-51836da0-817d-4e84-9bbf-7e45decc33d4 x-openstack-request-id: req-51836da0-817d-4e84-9bbf-7e45decc33d4 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:26:24.366728 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-unplugged", "status": "completed", "tag": "338936ea-fa25-4065-9970-6d7171659768", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:26:24.366981 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-51836da0-817d-4e84-9bbf-7e45decc33d4 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:26:24.367380 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'code': 200} Nov 16 03:26:24.388377 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b1f62841-9d78-43e9-839e-5dbc5df17504 req-afb8e668-bdce-4d39-8f0e-3d1ba0b19f46 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1102817 Nov 16 03:26:24.435905 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-b79527c3-e671-4d25-9895-e5fee819521c service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1016715 Nov 16 03:26:24.547412 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f4f4f486-2c8a-45e5-80ba-841dfe5bf745 req-49462876-2a31-4b90-9a50-52c7680d1df1 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010885 Nov 16 03:26:25.451901 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99fcc991-8e5b-42ce-aee0-72637a0647bf req-0a67cfe7-19a1-4004-99c8-785b3e354083 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:25.453406 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-99fcc991-8e5b-42ce-aee0-72637a0647bf req-0a67cfe7-19a1-4004-99c8-785b3e354083 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 946 time: 0.0548038 Nov 16 03:26:25.529758 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-99fcc991-8e5b-42ce-aee0-72637a0647bf req-e1437ebe-4b93-4565-b24f-86dd4b166235 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695150 Nov 16 03:26:25.541156 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8007bb60-6c8a-404d-b896-4f12cbed4522 req-986036f9-1fed-478c-8506-69a52aa0492b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:25.542792 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8007bb60-6c8a-404d-b896-4f12cbed4522 req-986036f9-1fed-478c-8506-69a52aa0492b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0763760 Nov 16 03:26:25.600674 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8007bb60-6c8a-404d-b896-4f12cbed4522 req-1d9f0952-3a36-428f-af3a-128b87654637 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507941 Nov 16 03:26:26.724927 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-985df6d9-f979-4ed0-9e2b-065243f006ba req-43565fc3-b75f-4e03-a37b-ace18a3131f3 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:26.726709 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-985df6d9-f979-4ed0-9e2b-065243f006ba req-43565fc3-b75f-4e03-a37b-ace18a3131f3 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0542912 Nov 16 03:26:26.782434 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-985df6d9-f979-4ed0-9e2b-065243f006ba req-bdae99b4-1698-4812-998f-583cfd2e05c0 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494893 Nov 16 03:26:27.900940 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2990abaa-0bb1-4454-9ee2-b6ae9dd2895e req-3a2d0aaf-364f-49e6-87eb-f6a22f5a5a00 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:27.902428 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2990abaa-0bb1-4454-9ee2-b6ae9dd2895e req-3a2d0aaf-364f-49e6-87eb-f6a22f5a5a00 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0500433 Nov 16 03:26:27.954607 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2990abaa-0bb1-4454-9ee2-b6ae9dd2895e req-a11111a3-57b5-4292-b128-5ab190bccddc tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432086 Nov 16 03:26:29.089935 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15f54a2-d50e-4155-b200-3aa55a7f4ca5 req-4f6ab022-4c5f-45a4-bd81-c0a035e57ef6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:29.091339 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d15f54a2-d50e-4155-b200-3aa55a7f4ca5 req-4f6ab022-4c5f-45a4-bd81-c0a035e57ef6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0588679 Nov 16 03:26:29.152380 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d15f54a2-d50e-4155-b200-3aa55a7f4ca5 req-6670941b-8ee8-4ca2-aa81-86f9d47b323d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542614 Nov 16 03:26:30.271156 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a09109-e972-47c8-b55a-fb1bf9878009 req-3cc38958-b744-401c-887c-d44bc4d4e435 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:30.272627 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0a09109-e972-47c8-b55a-fb1bf9878009 req-3cc38958-b744-401c-887c-d44bc4d4e435 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0510526 Nov 16 03:26:30.325172 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c0a09109-e972-47c8-b55a-fb1bf9878009 req-8872ecb0-a0ff-427d-bd92-a06b92c9448d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457299 Nov 16 03:26:31.454018 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7fca0e7-6c92-4e31-bb36-cb89e0701dc4 req-c16f5c2e-1ff4-4051-9c66-c9697a9f0309 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:31.455503 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7fca0e7-6c92-4e31-bb36-cb89e0701dc4 req-c16f5c2e-1ff4-4051-9c66-c9697a9f0309 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 944 time: 0.0564106 Nov 16 03:26:31.505603 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7fca0e7-6c92-4e31-bb36-cb89e0701dc4 req-6a30ea70-de5d-4ea7-8f8c-27f0ecb347ef tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438628 Nov 16 03:26:32.139527 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:26:32.240663 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:32.252599 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '338936ea-fa25-4065-9970-6d7171659768', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'port_id': '338936ea-fa25-4065-9970-6d7171659768', 'mac_address': 'fa:16:3e:89:7e:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 349, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:26:32.293731 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:32.307585 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 338936ea-fa25-4065-9970-6d7171659768 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:26:32.331807 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:32.338661 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:32.397904 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=7']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:26:32.645318 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5004af6f-3298-4367-9b93-d9e2ef58b622 req-16c4cf5b-4bec-4b8f-a6d6-9474d9a2e433 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:32.646831 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5004af6f-3298-4367-9b93-d9e2ef58b622 req-16c4cf5b-4bec-4b8f-a6d6-9474d9a2e433 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 945 time: 0.0593810 Nov 16 03:26:32.655485 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['338936ea-fa25-4065-9970-6d7171659768'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:26:32.698694 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5004af6f-3298-4367-9b93-d9e2ef58b622 req-923b96c3-5bfa-47b3-8cb4-9398b0520cb5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455000 Nov 16 03:26:33.826143 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a36dedf-299a-4b6b-81ad-ca9910498976 req-62d2a804-386d-492d-8af3-91d635fb8c83 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:33.827983 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7a36dedf-299a-4b6b-81ad-ca9910498976 req-62d2a804-386d-492d-8af3-91d635fb8c83 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 945 time: 0.0576854 Nov 16 03:26:33.891703 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7a36dedf-299a-4b6b-81ad-ca9910498976 req-6302e5fa-6ee5-4c21-a460-ad0721ecb394 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576642 Nov 16 03:26:34.151218 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:26:34.208270 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 338936ea-fa25-4065-9970-6d7171659768 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:26:34.208672 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:34.297125 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:34.326605 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:26:34.329110 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d9f6a39-f6e1-4225-b56a-a563c132eecf" -d '{"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-plugged", "status": "completed", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:26:34.346022 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:26:34.352027 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:34.375733 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:26:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2681177c-1248-4364-85ff-38e579a39804 x-openstack-request-id: req-2681177c-1248-4364-85ff-38e579a39804 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:26:34.376034 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-plugged", "status": "completed", "tag": "338936ea-fa25-4065-9970-6d7171659768", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:26:34.376298 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-2681177c-1248-4364-85ff-38e579a39804 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:26:34.376676 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'code': 200} Nov 16 03:26:34.404549 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=8']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:26:34.687633 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce1059a-d7e9-4555-b97f-6efbcb69b63c req-31a7d4dd-c31c-4d41-b4fd-356059be468c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:34.689113 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fce1059a-d7e9-4555-b97f-6efbcb69b63c req-31a7d4dd-c31c-4d41-b4fd-356059be468c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1099 time: 0.0509629 Nov 16 03:26:34.741573 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fce1059a-d7e9-4555-b97f-6efbcb69b63c req-63f95ef9-30f1-459b-98f2-7158b99ca3bd service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449586 Nov 16 03:26:35.018172 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9410b0d7-bb2b-46e2-a5ea-3276ca441a85 req-70c559eb-b5d3-4b64-8389-89870bd45907 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:35.019703 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9410b0d7-bb2b-46e2-a5ea-3276ca441a85 req-70c559eb-b5d3-4b64-8389-89870bd45907 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0512843 Nov 16 03:26:35.075601 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9410b0d7-bb2b-46e2-a5ea-3276ca441a85 req-e146390b-58fb-4df1-9c4c-8f80df531b74 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471375 Nov 16 03:26:35.943269 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:36.220961 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7594f92e-27c6-4b54-9f4b-908a8dca9aae req-f8383c7f-fc66-4eb0-a0d6-6d48c0b4532d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:36.222562 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7594f92e-27c6-4b54-9f4b-908a8dca9aae req-f8383c7f-fc66-4eb0-a0d6-6d48c0b4532d tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0597355 Nov 16 03:26:36.288730 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7594f92e-27c6-4b54-9f4b-908a8dca9aae req-91efb923-abdf-4ae9-96e7-3d310dae1680 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581086 Nov 16 03:26:44.368195 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-90c0ab9d-f4fe-4dcc-9b45-ec9a90af6736 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:48.455083 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-aa0524be-9855-4bce-8845-08144705a2db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:49.798843 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:51.532379 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:51.599955 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:26:55.142914 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:26:59.244298 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d765cb-51d1-49e1-b5e7-243d79683725 req-a3024996-7152-41f7-881e-a35efd1a1f3d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:26:59.246126 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3d765cb-51d1-49e1-b5e7-243d79683725 req-a3024996-7152-41f7-881e-a35efd1a1f3d tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 946 time: 0.0543787 Nov 16 03:26:59.296462 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b3d765cb-51d1-49e1-b5e7-243d79683725 req-84a146fb-8d1a-4719-8ca7-f581e91e29f2 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440791 Nov 16 03:27:00.430279 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e80197-a7e4-4cb5-88c1-022f28a2dc2b req-35e11707-d7e2-4839-a514-54acb1de6688 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:00.431867 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-96e80197-a7e4-4cb5-88c1-022f28a2dc2b req-35e11707-d7e2-4839-a514-54acb1de6688 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 946 time: 0.0590191 Nov 16 03:27:00.492153 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-96e80197-a7e4-4cb5-88c1-022f28a2dc2b req-0980e645-35e7-41b7-af80-f439f456b849 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups?id=894ffe28-6a64-4566-8835-8f427b69c238&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0531223 Nov 16 03:27:00.876281 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-49c62c1c-765f-4881-a28d-eee97c32ab49 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:00.877849 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-49c62c1c-765f-4881-a28d-eee97c32ab49 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 946 time: 0.0500290 Nov 16 03:27:00.983746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Deleting port ec43ffb7-58ab-410e-be98-b04fa6fa5472 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:00.984027 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:01.078918 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] For port ec43ffb7-58ab-410e-be98-b04fa6fa5472, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ec43ffb7-58ab-410e-be98-b04fa6fa5472,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:01.079187 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:01.252626 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:01.252989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:01.253320 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Floating IP 733614a2-3e66-4704-b5d9-e131749f22f6 disassociated. External IP: 172.27.1.85, port: ec43ffb7-58ab-410e-be98-b04fa6fa5472. Nov 16 03:27:01.253666 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Calling delete_port for ec43ffb7-58ab-410e-be98-b04fa6fa5472 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:01.397899 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:01.426311 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event deleted for resources: {'Port': ['ID=ec43ffb7-58ab-410e-be98-b04fa6fa5472,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:01.438530 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.439097 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.439193 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.439522 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.439854 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.440186 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.440511 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.440832 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.441153 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.441497 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.441819 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.442135 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:01.555922 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:01.697826 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca2d1d1c-f573-4b1a-aeff-634f9f0a2ee1 req-d2eb0454-9a6c-457c-bd90-60a471474e9f tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ff4e176-32ce-4b48-acd7-c7f1464ae9f7 HTTP/1.1" status: 200 len: 210 time: 0.0889146 Nov 16 03:27:01.711363 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:01.732219 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:01.743502 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:01.744410 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:01.764557 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] No DVR routers for this DVR port ec43ffb7-58ab-410e-be98-b04fa6fa5472 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:01.767196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:01.770646 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-cc9fa65b-910e-42ef-bed4-e03991d2f2d5 req-1ed80021-3227-44a8-9aed-2062a56b43ef tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.11 "DELETE /v2.0/ports/ec43ffb7-58ab-410e-be98-b04fa6fa5472 HTTP/1.1" status: 204 len: 173 time: 0.8845968 Nov 16 03:27:01.771146 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-deleted', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:01.774071 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d0a05b8-a45f-460e-95e7-efb029bcf2b6" -d '{"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-deleted", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:01.820894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-daf5ff98-bf72-4e32-ba81-777582982571 x-openstack-request-id: req-daf5ff98-bf72-4e32-ba81-777582982571 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:01.820894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ff4e176-32ce-4b48-acd7-c7f1464ae9f7", "name": "network-vif-deleted", "tag": "ec43ffb7-58ab-410e-be98-b04fa6fa5472", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:01.820894 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-daf5ff98-bf72-4e32-ba81-777582982571 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:01.821271 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ff4e176-32ce-4b48-acd7-c7f1464ae9f7', 'name': 'network-vif-deleted', 'tag': 'ec43ffb7-58ab-410e-be98-b04fa6fa5472', 'status': 'completed', 'code': 200} Nov 16 03:27:01.873715 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:02.102606 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:02.130241 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:02.140070 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:02.140841 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:02.257039 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:02.474392 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:02.501400 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abcda42a-f782-4900-84e8-faabc74b3458 None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:20:43Z', 'revision_number': 4, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '04d186a9-0a0b-497c-8c8f-737a90f61291', 'name': '', 'network_id': '9af16874-689f-4be5-82a5-a21abe98a824', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'mac_address': 'fa:16:3e:a2:9e:96', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_interface', 'standard_attr_id': 510, 'fixed_ips': [{'subnet_id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:42Z', 'updated_at': '2021-11-16T03:20:50Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'subnets': [{'id': '9e247800-f503-4caf-a4ea-6ee4bbc46e25', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:02.730149 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001c8768-fd5b-4dbe-ae4e-53655da411d3 None None] New status for floating IP 733614a2-3e66-4704-b5d9-e131749f22f6: DOWN {{(pid=101901) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:27:03.819221 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50456) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:03.883957 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:03.912397 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:03.967482 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:03.972500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:03.974072 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "DELETE /v2.0/security-groups/894ffe28-6a64-4566-8835-8f427b69c238 HTTP/1.1" status: 204 len: 168 time: 0.1537552 Nov 16 03:27:03.977136 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50460) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:03.984093 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=894ffe28-6a64-4566-8835-8f427b69c238,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:03.991400 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.992031 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.992157 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.992392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.992824 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.993040 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.993243 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.api.v2.resource [None req-327ca90f-befb-4ebb-8d41-3586151f01e0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] show failed (client error): The resource could not be found. Nov 16 03:27:03.993361 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.993694 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.994019 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.994331 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.994695 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-327ca90f-befb-4ebb-8d41-3586151f01e0 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "GET /v2.0/security-groups/894ffe28-6a64-4566-8835-8f427b69c238 HTTP/1.1" status: 404 len: 347 time: 0.0161777 Nov 16 03:27:03.994814 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.994983 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-865d473d-eb8b-4323-b4cc-a3ffc9d8b0c4 tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:03.998524 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50462) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:04.131008 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Deleting port 4aa957d2-7b9f-4f5d-a385-8992760ae392 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:04.131267 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:04.219297 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:04.219637 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:04.236392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Calling delete_port for 4aa957d2-7b9f-4f5d-a385-8992760ae392 owned by network:floatingip {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:04.296230 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:04.320022 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: ec43ffb7-58ab-410e-be98-b04fa6fa5472 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:04.320362 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device ec43ffb7-58ab-410e-be98-b04fa6fa5472 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:04.375731 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:04.409457 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Pushing event deleted for resources: {'Port': ['ID=4aa957d2-7b9f-4f5d-a385-8992760ae392,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:04.475663 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks [] for floatingip, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:04.478272 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:04.479488 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-83cd6cd0-3d72-4181-818c-b194ea7c04fd tempest-AttachVolumeShelveTestJSON-1095204780 tempest-AttachVolumeShelveTestJSON-1095204780-project] 10.222.0.31 "DELETE /v2.0/floatingips/733614a2-3e66-4704-b5d9-e131749f22f6 HTTP/1.1" status: 204 len: 168 time: 0.4799993 Nov 16 03:27:05.944510 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:06.925720 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50484) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:07.386533 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:07.645324 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Deleting port 04d186a9-0a0b-497c-8c8f-737a90f61291 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:07.645610 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:07.735996 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] For port 04d186a9-0a0b-497c-8c8f-737a90f61291, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=04d186a9-0a0b-497c-8c8f-737a90f61291,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:07.736477 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:07.760917 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Calling delete_port for 04d186a9-0a0b-497c-8c8f-737a90f61291 owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:07.964942 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:07.992903 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Pushing event deleted for resources: {'Port': ['ID=04d186a9-0a0b-497c-8c8f-737a90f61291,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:08.207872 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:08.448622 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:08.559067 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:08.564012 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-32ad160c-0329-4e4e-b859-5d76433b4158 admin admin] 10.222.0.31 "PUT /v2.0/routers/f0f29b2e-1450-4ba9-970f-d8f3d4193b97/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6372812 Nov 16 03:27:08.566664 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50490) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:08.569571 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] Sync routers for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:08.582302 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:08.582905 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:08.669346 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks [] for router, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:08.772631 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:08.819892 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:08.835985 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Deleting port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:08.836357 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:08.932350 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] For port 65d2ee09-0dda-4c92-9983-1bcd281d4ad9, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:08.932935 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:08.948812 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Calling delete_port for 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 owned by network:router_gateway {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:09.011033 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58'}], 'enable_snat': True}, 'gw_port_id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:27:07Z', 'revision_number': 5, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port': {'id': '65d2ee09-0dda-4c92-9983-1bcd281d4ad9', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8c:7b:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 504, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:20:38Z', 'updated_at': '2021-11-16T03:20:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:09.042470 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] Checking router: f0f29b2e-1450-4ba9-970f-d8f3d4193b97 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:09.057326 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] Routers {'f0f29b2e-1450-4ba9-970f-d8f3d4193b97'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:09.058921 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:09.135034 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.155030 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] Set router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 gateway port host: None {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:09.161602 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Pushing event deleted for resources: {'Port': ['ID=65d2ee09-0dda-4c92-9983-1bcd281d4ad9,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:09.210536 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:27:08Z', 'revision_number': 6, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port_host': None}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:09.226853 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.242441 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee53ff32-aa68-4dd2-a1f1-506d06da84f5 None None] The sync data for ids ['f0f29b2e-1450-4ba9-970f-d8f3d4193b97'] in dv-cinder-818037-1-iscsi is: [{'id': 'f0f29b2e-1450-4ba9-970f-d8f3d4193b97', 'name': 'tempest-AttachVolumeShelveTestJSON-684471443-router', 'tenant_id': '2852179c69834bda8a41052f2d958cd4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:20:37Z', 'updated_at': '2021-11-16T03:27:08Z', 'revision_number': 6, 'project_id': '2852179c69834bda8a41052f2d958cd4', 'gw_port_host': None}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:09.320343 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.322631 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.368613 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.369209 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Fanout notify agent at l3_agent the message router_deleted on router f0f29b2e-1450-4ba9-970f-d8f3d4193b97 {{(pid=101898) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:27:09.374679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.375854 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1e4637be-377c-4499-a4ef-fdea3f6d8b9a admin admin] 10.222.0.31 "DELETE /v2.0/routers/f0f29b2e-1450-4ba9-970f-d8f3d4193b97 HTTP/1.1" status: 204 len: 168 time: 0.8082688 Nov 16 03:27:09.378571 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50494) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:09.429565 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Deleting subnet 9e247800-f503-4caf-a4ea-6ee4bbc46e25 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:27:09.432920 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.468473 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.550302 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.630388 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.670580 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9e247800-f503-4caf-a4ea-6ee4bbc46e25,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:09.674450 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.678029 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-6ba47af0-3941-44fd-be94-e82eddff388e admin admin] 10.222.0.31 "DELETE /v2.0/subnets/9e247800-f503-4caf-a4ea-6ee4bbc46e25 HTTP/1.1" status: 204 len: 168 time: 0.2983170 Nov 16 03:27:09.680509 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50496) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:09.685293 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5ea5dc4-2296-4ebb-8804-d0c2525ba973 None None] Network 9af16874-689f-4be5-82a5-a21abe98a824 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:27:09.736470 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 04d186a9-0a0b-497c-8c8f-737a90f61291 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:09.758540 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.766129 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 04d186a9-0a0b-497c-8c8f-737a90f61291 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:09.766475 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 04d186a9-0a0b-497c-8c8f-737a90f61291 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:09.819389 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Deleting port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:09.819726 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.890532 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] For port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,segment=NetworkSegment(5625e5e7-479e-49a0-b312-cb57638f9297),segment_id=5625e5e7-479e-49a0-b312-cb57638f9297)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:09.890893 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:09.904516 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Calling delete_port for fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 owned by network:dhcp {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:09.989388 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.021777 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] No DVR routers for this DVR port fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 on host dv-cinder-818037-1-iscsi {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:10.025829 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Pushing event deleted for resources: {'Port': ['ID=fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:10.056701 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16fe54c5-043a-43d1-809d-d65de5fd3f67 None None] DHCP port deletion for 9af16874-689f-4be5-82a5-a21abe98a824 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:27:10.103841 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.125672 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9af16874-689f-4be5-82a5-a21abe98a824']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:10.135976 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5625e5e7-479e-49a0-b312-cb57638f9297') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:10.136280 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5625e5e7-479e-49a0-b312-cb57638f9297') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:10.148005 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.164537 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.172697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Releasing vlan 347 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:27:10.173065 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:27:10.175354 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:27:10.241887 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.247258 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.252798 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] 10.222.0.31 "DELETE /v2.0/networks/9af16874-689f-4be5-82a5-a21abe98a824 HTTP/1.1" status: 204 len: 168 time: 0.5687518 Nov 16 03:27:10.264782 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330a6b5c-d023-487c-beca-9bcbb40b0945 admin admin] Pushing event deleted for resources: {'Network': ['ID=9af16874-689f-4be5-82a5-a21abe98a824,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:10.398678 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50500) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:10.463619 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-90d6fc53-9024-44b2-846d-69fe71166c29 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=2852179c69834bda8a41052f2d958cd4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0632100 Nov 16 03:27:10.466920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50502) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:10.526399 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ded39a7b-e724-4f68-aead-56b500248de3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.560253 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ded39a7b-e724-4f68-aead-56b500248de3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.624619 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ded39a7b-e724-4f68-aead-56b500248de3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.627885 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ded39a7b-e724-4f68-aead-56b500248de3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:10.629196 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ded39a7b-e724-4f68-aead-56b500248de3 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4835c79f-ca18-4dad-b1d1-dd358884040e HTTP/1.1" status: 204 len: 168 time: 0.1611867 Nov 16 03:27:10.643204 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ded39a7b-e724-4f68-aead-56b500248de3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4835c79f-ca18-4dad-b1d1-dd358884040e,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:11.421121 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50524) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:11.501202 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:11.523350 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:11.523722 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device fd6cf896-a1d1-4228-ad18-7cb1eb0c00f1 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:11.524083 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:11.531050 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-979775485-network', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:11.554201 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:11.554522 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 65d2ee09-0dda-4c92-9983-1bcd281d4ad9 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:11.567495 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Made reservation on behalf of d0da71fd700f4fad877f51e2e7d7862e for: {'network': 1} {{(pid=101898) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:27:11.570561 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for network, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.580809 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.665036 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.669746 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.696211 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 317} {{(pid=101898) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 16 03:27:11.705730 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff8ab586-4d54-4614-8a52-ab714313b262,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:11.714016 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.714016 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.db.segments_db [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Added segment aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849 of type vlan for network c03637ab-b657-4c86-ac98-370101bc4e03 Nov 16 03:27:11.756987 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789857544695'] for network, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.787073 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440'] for network, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.788325 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101898) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:11.789114 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:11.854111 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] 10.222.0.31 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4316034 Nov 16 03:27:11.857077 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50528) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:11.862345 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Request body: {'subnet': {'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-979775485-subnet', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:11.866520 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a04b630-3fd3-4f75-b728-6308cba3bee9 admin admin] Pushing event updated for resources: {'Network': ['ID=c03637ab-b657-4c86-ac98-370101bc4e03,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:11.876887 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Network c03637ab-b657-4c86-ac98-370101bc4e03 details requested by agent ovs-agent-dv-cinder-818037-1-iscsi with host dv-cinder-818037-1-iscsi {{(pid=101900) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 16 03:27:11.888553 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Made reservation on behalf of d0da71fd700f4fad877f51e2e7d7862e for: {'subnet': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:27:11.891878 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126233457'] for subnet, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.075174 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126058202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126233443'] for subnet, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.130966 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b91ded4-cd47-4ff5-a654-a81d51bab14e,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:12.141380 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Checking segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:27:12.141762 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Network hostable DHCP agents. Network: c03637ab-b657-4c86-ac98-370101bc4e03, hostable agents: ['24ca167e-a00e-41e1-82f8-5ded23329723'], hosted agents: [] {{(pid=101899) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 16 03:27:12.162298 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Network c03637ab-b657-4c86-ac98-370101bc4e03 is scheduled to be hosted by DHCP agent 24ca167e-a00e-41e1-82f8-5ded23329723 with binding_index 1 {{(pid=101899) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 16 03:27:12.173865 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-1-iscsi, c03637ab-b657-4c86-ac98-370101bc4e03) {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:12.178523 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:12.179157 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.183557 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-947149f2-8acb-46db-869d-14def73aa198 None None] Network c03637ab-b657-4c86-ac98-370101bc4e03 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:27:12.200699 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-388d17b4-6c64-4556-a9c7-93c96d28b869 admin admin] 10.222.0.31 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3423576 Nov 16 03:27:12.204022 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50530) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:12.209174 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:12.231888 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-564282', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-3341'] for router, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.233381 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-564310', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-557505', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-686012', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-3334'] for router, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.285621 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.331809 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp246c378c-5c90-5d40-a69f-c5fa72002f2b-c03637ab-b657-4c86-ac98-370101bc4e03', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e'}]}} from dv-cinder-818037-1-iscsi. {{(pid=101900) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 16 03:27:12.332690 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.475851 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.db_base_plugin_common [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Allocated IP 172.20.0.2 (c03637ab-b657-4c86-ac98-370101bc4e03/4b91ded4-cd47-4ff5-a654-a81d51bab14e/af9aa015-213f-4a14-9dde-26dcbb1b867c) {{(pid=101900) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:27:12.638236 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Publish callbacks [] for port, precommit_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.644658 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756'] for port, after_create {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.687604 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Network c03637ab-b657-4c86-ac98-370101bc4e03 is already hosted by enough agents. {{(pid=101900) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:27:12.690771 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.scheduler.base_scheduler [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Resources bound (agent type, host, resource id): {{(pid=101900) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:12.694515 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Received port after_create {{(pid=101900) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:27:12.700108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Pushing event updated for resources: {'Port': ['ID=af9aa015-213f-4a14-9dde-26dcbb1b867c,revision_number=1']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:12.704964 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.712010 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.712350 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.712664 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.712992 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.713308 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.713658 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.713982 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.714302 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.714630 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.714954 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.715261 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.715592 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:12.763331 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Attempting to bind port af9aa015-213f-4a14-9dde-26dcbb1b867c on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:27:12.763599 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Attempting to bind port af9aa015-213f-4a14-9dde-26dcbb1b867c by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:27:12.763960 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Attempting to bind port af9aa015-213f-4a14-9dde-26dcbb1b867c on network c03637ab-b657-4c86-ac98-370101bc4e03 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:27:12.769244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 26, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:27:12.769720 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Checking segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:27:12.770125 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.770515 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Bound using segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:27:12.770977 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Bound port: af9aa015-213f-4a14-9dde-26dcbb1b867c, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:27:12.771367 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.842338 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] For port af9aa015-213f-4a14-9dde-26dcbb1b867c, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:27:12.846329 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] For port af9aa015-213f-4a14-9dde-26dcbb1b867c, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=af9aa015-213f-4a14-9dde-26dcbb1b867c,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:27:12.850626 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.907769 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:12.908303 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0b38d8-c1cf-4bdd-863f-26fbd243fe89 None None] Pushing event updated for resources: {'Port': ['ID=af9aa015-213f-4a14-9dde-26dcbb1b867c,revision_number=2']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:12.930954 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.039218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Allocated IP 172.27.1.87 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/dcd7f15e-c124-4a85-8daf-afcd66778542) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:27:13.169878 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.204841 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.244649 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:27:13.247707 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:13.251602 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:27:13.257026 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Pushing event updated for resources: {'Port': ['ID=dcd7f15e-c124-4a85-8daf-afcd66778542,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:13.512786 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.529763 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device af9aa015-213f-4a14-9dde-26dcbb1b867c up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:27:13.581145 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port af9aa015-213f-4a14-9dde-26dcbb1b867c triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:13.581415 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.665803 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.701564 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port af9aa015-213f-4a14-9dde-26dcbb1b867c, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=af9aa015-213f-4a14-9dde-26dcbb1b867c,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:13.707407 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.727358 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-564303', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-557342'] for router, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.759925 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=af9aa015-213f-4a14-9dde-26dcbb1b867c,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:13.861738 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d11ff73-4f11-4a9d-8af8-bf68a99d50f4 None None] Network c03637ab-b657-4c86-ac98-370101bc4e03 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:27:13.877853 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Router 434fedcd-dbea-44e4-b250-de8dc3af705a is scheduled to L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 with binding_index 1 {{(pid=101898) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 16 03:27:13.966633 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-d16835c0-6875-4667-8af8-7ece90daf8f8 None None] Provisioning complete for port af9aa015-213f-4a14-9dde-26dcbb1b867c triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:13.966992 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d16835c0-6875-4667-8af8-7ece90daf8f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:13.990558 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:14.002478 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:14.011819 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.015470 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c91cada7-e5a9-4e29-8f34-9013f3a2bd53 admin admin] 10.222.0.31 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.8073375 Nov 16 03:27:14.015723 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:14.015848 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50532) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:14.016484 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:14.124490 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:14.317794 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:13Z', 'revision_number': 3, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:14.337073 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-d1fcf0f2-0812-4ec4-bff1-6aefa7cdad40 None None] Provisioning complete for port af9aa015-213f-4a14-9dde-26dcbb1b867c triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:14.337626 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d1fcf0f2-0812-4ec4-bff1-6aefa7cdad40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.345556 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:14.345891 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Updating router 434fedcd-dbea-44e4-b250-de8dc3af705a port dcd7f15e-c124-4a85-8daf-afcd66778542 binding host dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:27:14.373234 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.384966 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-4aa34789-1c88-43ad-8904-91dc4d25ebaf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.450170 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.622897 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Allocated IP 172.20.0.1 (c03637ab-b657-4c86-ac98-370101bc4e03/4b91ded4-cd47-4ff5-a654-a81d51bab14e/25a1ab15-dc3e-4832-9d11-1fc6c24d8404) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:27:14.635304 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Publish callbacks [] for port, precommit_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.643344 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.692305 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Attempting to bind port dcd7f15e-c124-4a85-8daf-afcd66778542 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:27:14.692671 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Attempting to bind port dcd7f15e-c124-4a85-8daf-afcd66778542 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:27:14.693023 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Attempting to bind port dcd7f15e-c124-4a85-8daf-afcd66778542 on network 0589aea0-39a1-4e64-bdfc-1695da7bfecf {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:27:14.701602 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 26, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:27:14.701951 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Checking segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101901) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:27:14.702336 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.702786 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Bound using segment: {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'} {{(pid=101901) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:27:14.703179 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.managers [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Bound port: dcd7f15e-c124-4a85-8daf-afcd66778542, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'adc7bcd9-ce4d-4ced-baf2-487066118c1f', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}}] {{(pid=101901) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:27:14.703580 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.705196 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Pushing event updated for resources: {'Port': ['ID=dcd7f15e-c124-4a85-8daf-afcd66778542,revision_number=2']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:14.729395 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.731628 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.731991 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.732321 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.732639 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.732963 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.733290 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.733628 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.733942 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.734268 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.734759 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.735100 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.735431 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101901) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:27:14.764908 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.767232 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] For port dcd7f15e-c124-4a85-8daf-afcd66778542, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101901) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:27:14.770323 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.plugins.ml2.db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] For port dcd7f15e-c124-4a85-8daf-afcd66778542, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=dcd7f15e-c124-4a85-8daf-afcd66778542,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101901) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:27:14.775817 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron_lib.callbacks.manager [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101901) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.815633 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Network c03637ab-b657-4c86-ac98-370101bc4e03 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:27:14.818915 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:14.826163 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:27:14.831282 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:14.831951 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:14.845973 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Pushing event updated for resources: {'Port': ['ID=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:14.876670 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-670401'] for router_interface, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:14.905836 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ad4eb3-4f84-41c8-8985-4e1dfddf5357 None None] Pushing event updated for resources: {'Port': ['ID=dcd7f15e-c124-4a85-8daf-afcd66778542,revision_number=3']} {{(pid=101901) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:14.965731 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:15.020052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.061569 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-7f0d828a-ae67-4c21-853c-5beb6480fdef None None] Provisioning complete for port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:15.062699 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7f0d828a-ae67-4c21-853c-5beb6480fdef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.104218 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-7f0d828a-ae67-4c21-853c-5beb6480fdef None None] Port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:27:15.164657 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:13Z', 'revision_number': 3, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:15.191431 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.197074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.198553 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b065ad0-43b8-4420-9c67-003390739b52 None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:13Z', 'revision_number': 3, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:15.269019 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Pushing event updated for resources: {'Port': ['ID=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:15.274978 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-605490', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-670301'] for router_interface, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.374627 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Network c03637ab-b657-4c86-ac98-370101bc4e03 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:27:15.376182 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:15.540175 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Router 434fedcd-dbea-44e4-b250-de8dc3af705a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:15.659353 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device af9aa015-213f-4a14-9dde-26dcbb1b867c up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:27:15.674068 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:15.679333 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7eb3a353-7ba7-4ead-8336-f47c5d973801 admin admin] 10.222.0.31 "PUT /v2.0/routers/434fedcd-dbea-44e4-b250-de8dc3af705a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6617668 Nov 16 03:27:15.712324 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port af9aa015-213f-4a14-9dde-26dcbb1b867c triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:15.712783 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.760701 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-ee246d35-7336-4c8f-b822-46ae9f73e1a3 None None] Provisioning complete for port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:15.761067 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-ee246d35-7336-4c8f-b822-46ae9f73e1a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:15.961995 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-ee246d35-7336-4c8f-b822-46ae9f73e1a3 None None] Port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:27:15.980702 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device dcd7f15e-c124-4a85-8daf-afcd66778542 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:27:16.032295 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port dcd7f15e-c124-4a85-8daf-afcd66778542 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:16.032714 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.116477 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.139637 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] For port dcd7f15e-c124-4a85-8daf-afcd66778542, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=dcd7f15e-c124-4a85-8daf-afcd66778542,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:16.146311 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.196785 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Pushing event updated for resources: {'Port': ['ID=dcd7f15e-c124-4a85-8daf-afcd66778542,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:16.355036 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50540) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:16.360177 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1228636374', 'description': 'tempest-description--1605681784'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:16.384754 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.457167 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.461327 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.492260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.493487 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1374364 Nov 16 03:27:16.496467 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50542) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:16.497996 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bc3942-f4b6-49aa-b20d-3a7edc985237 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:16.501122 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'security_group_rule': {'security_group_id': '6f1e7928-7dac-46b0-adc7-3fe97e7b5a49', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:16.529916 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.591363 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.596269 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.614050 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2921ddbb-de20-459e-a50a-c2f8f9c5b2fe,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:16.622179 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.626118 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3ea07e9f-84c8-43fa-9353-913098c80514 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1259291 Nov 16 03:27:16.626449 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50544) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:16.631003 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'security_group_rule': {'security_group_id': '6f1e7928-7dac-46b0-adc7-3fe97e7b5a49', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:16.660166 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.721981 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.726624 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.744754 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0059fb3-1431-4035-9109-6ed277ea6a02,revision_number=0']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:16.754691 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.756300 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-cb4b2267-b6ca-4f9c-a332-1b805a1fe5a6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1288757 Nov 16 03:27:16.760014 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50546) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:16.764910 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:16.790800 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.868420 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:16.879877 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:16.880464 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:16.895138 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:16.995281 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:17.014309 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Allocated IP 172.27.1.15 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/13f0efb6-1e7e-4b8b-8e03-9866cf01681b) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:27:17.120746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.155235 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.198127 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:27:17.200975 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:15Z', 'revision_number': 2, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:17.201738 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:17.205949 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:27:17.227617 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'Port': ['ID=13f0efb6-1e7e-4b8b-8e03-9866cf01681b,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:17.227877 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:17.228020 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Updating router 434fedcd-dbea-44e4-b250-de8dc3af705a port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 binding host dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 16 03:27:17.253663 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.297159 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.338081 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.579212 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Publish callbacks [] for port, precommit_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.587640 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.626626 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device dcd7f15e-c124-4a85-8daf-afcd66778542 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:27:17.695753 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00aeeb73-0bc0-4e8e-a246-4a380d2ce86e None None] Pushing event updated for resources: {'Port': ['ID=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,revision_number=3']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:17.775689 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Attempting to bind port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 on host dv-cinder-818037-1-iscsi for vnic_type normal with profile {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:27:17.776444 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Attempting to bind port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 by drivers openvswitch,hyperv on host dv-cinder-818037-1-iscsi at level 0 using segments [{'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:27:17.777272 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Attempting to bind port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 on network c03637ab-b657-4c86-ac98-370101bc4e03 {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:27:17.785041 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Checking agent: {'id': '8490b546-ebe2-4c67-9417-7a726b2e8d29', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 8, 52), 'started_at': datetime.datetime(2021, 11, 16, 3, 9, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 26, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:27:17.785471 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Checking segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101900) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:27:17.785867 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.786381 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Bound using segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} {{(pid=101900) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:27:17.786882 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.managers [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Bound port: 25a1ab15-dc3e-4832-9d11-1fc6c24d8404, host: dv-cinder-818037-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}}] {{(pid=101900) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:27:17.787258 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.797668 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port dcd7f15e-c124-4a85-8daf-afcd66778542 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:17.798250 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.809654 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.815599 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.885141 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'Port': ['ID=13f0efb6-1e7e-4b8b-8e03-9866cf01681b,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:17.900771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.916534 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.924498 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-640f9c83-0dca-4d7c-b24f-6678e521939e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1568487 Nov 16 03:27:17.937630 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] For port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404, host dv-cinder-818037-1-iscsi, cleared binding levels {{(pid=101900) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:27:17.951436 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-6ca4792b-163e-4aae-8705-946a48965101 None None] Provisioning complete for port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:17.951801 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6ca4792b-163e-4aae-8705-946a48965101 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:17.955016 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] For port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404, host dv-cinder-818037-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:27:17.982764 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:18.031804 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-6ca4792b-163e-4aae-8705-946a48965101 None None] Port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:27:18.063047 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00aeeb73-0bc0-4e8e-a246-4a380d2ce86e None None] Pushing event updated for resources: {'Port': ['ID=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:18.065759 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:18.066573 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:26:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:18.200596 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:18.264805 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-fdb5ffbb-4daa-4465-8265-58ab0e011401 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--1228636374&fields=id&tenant_id=d0da71fd700f4fad877f51e2e7d7862e HTTP/1.1" status: 200 len: 267 time: 0.0488226 Nov 16 03:27:18.329176 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-1acb85bc-137c-46b6-86d8-01208e6c6030 None None] Provisioning complete for port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:18.329830 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1acb85bc-137c-46b6-86d8-01208e6c6030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:18.377837 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-33527526-1c6b-436d-8dc4-97dacd04e472 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:18.379429 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-33527526-1c6b-436d-8dc4-97dacd04e472 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 810 time: 0.1069276 Nov 16 03:27:18.395009 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-a8a94d27-3b6c-4add-b6ee-8433aac6599b tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/quotas/d0da71fd700f4fad877f51e2e7d7862e HTTP/1.1" status: 200 len: 375 time: 0.0097883 Nov 16 03:27:18.457593 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6eeb0b8a-4da6-4497-bb5c-a68419503679 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0564439 Nov 16 03:27:18.475052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-baa65bc0-7c1f-4ab5-9b9c-18acd3fec869 service neutron] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:27:18.476560 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-baa65bc0-7c1f-4ab5-9b9c-18acd3fec869 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056038 Nov 16 03:27:18.480393 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fc7f8667-195b-40ae-a8be-b461ddec3f07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:18.483431 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1acb85bc-137c-46b6-86d8-01208e6c6030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:18.525976 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-1acb85bc-137c-46b6-86d8-01208e6c6030 None None] For port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:18.535029 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:17Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:18.541759 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1acb85bc-137c-46b6-86d8-01208e6c6030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:18.569319 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29839942-1aa5-45f6-ac9c-78d4bb872957 None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:17Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:18.591258 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-bb5cd76b-b87f-4653-b14a-0aa8c2217163 service neutron] 10.222.0.31 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1064470 Nov 16 03:27:18.635921 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1acb85bc-137c-46b6-86d8-01208e6c6030 None None] Pushing event updated for resources: {'Port': ['ID=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:18.714937 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-94fecf04-2ac9-412e-bedd-cc7771cff094 service neutron] 10.222.0.31 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1157601 Nov 16 03:27:18.901030 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a7eea4f-abe2-401c-aefd-7c58142ceeba req-fa203075-671e-45f3-97fd-b5c9791627ff tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 210 time: 0.0299726 Nov 16 03:27:19.630954 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 up at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:27:19.685007 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Provisioning complete for port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:19.685372 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:19.800797 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:20.002061 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d31ccdb6-acf5-46cb-a9eb-2e083c5a0480 req-779712d9-958f-44c5-884b-37e8b43ccf07 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 210 time: 0.0273485 Nov 16 03:27:20.186046 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-396a81a4-757b-4f1e-b138-e452a2a54764 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:20.187481 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-396a81a4-757b-4f1e-b138-e452a2a54764 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 810 time: 0.1191649 Nov 16 03:27:20.258157 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-71f0f8a1-e175-49ac-9aad-85db4c923ecd tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d0da71fd700f4fad877f51e2e7d7862e HTTP/1.1" status: 200 len: 380 time: 0.0543916 Nov 16 03:27:20.267793 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'port': {'device_id': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'admin_state_up': True, 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'security_groups': ['6f1e7928-7dac-46b0-adc7-3fe97e7b5a49']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:20.388769 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Made reservation on behalf of d0da71fd700f4fad877f51e2e7d7862e for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:27:20.392518 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:20.554607 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Allocated IP 172.20.0.14 (c03637ab-b657-4c86-ac98-370101bc4e03/4b91ded4-cd47-4ff5-a654-a81d51bab14e/a95128b4-a01f-412c-b4d9-9d6e78a05ae9) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:27:20.700382 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:20.737980 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:20.786344 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Network c03637ab-b657-4c86-ac98-370101bc4e03 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:27:20.789332 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:27:20.796051 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:27:20.832401 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'Port': ['ID=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:20.861107 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:20.861788 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:20.881748 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-835fb096-3375-4b4e-a858-f0fd058e245a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6177998 Nov 16 03:27:20.893270 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-4d41a220-104b-452a-8892-ee35308deb14 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] http://10.222.0.31:9696/v2.0/extensions returned with HTTP 200 {{(pid=101899) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 16 03:27:20.894310 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-4d41a220-104b-452a-8892-ee35308deb14 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058200 Nov 16 03:27:20.965136 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Request body: {'port': {'device_id': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:20.977630 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-e5f83023-a83d-4085-acc4-92122d0e20d7 None None] Provisioning complete for port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:20.978218 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e5f83023-a83d-4085-acc4-92122d0e20d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.016377 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-e5f83023-a83d-4085-acc4-92122d0e20d7 None None] Port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:27:21.024031 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.241209 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c88ce869-555f-464a-8f18-3a5e349f89c6 req-b7f1b1de-cae5-4398-ad82-4ae588d950e1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:21.242778 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c88ce869-555f-464a-8f18-3a5e349f89c6 req-b7f1b1de-cae5-4398-ad82-4ae588d950e1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 932 time: 0.1684902 Nov 16 03:27:21.334446 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c88ce869-555f-464a-8f18-3a5e349f89c6 req-dc73de01-acd2-4f30-b8f0-127e2dc7fa84 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0791540 Nov 16 03:27:21.393175 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a95128b4-a01f-412c-b4d9-9d6e78a05ae9 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:27:21.400954 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.413878 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Transition to ACTIVE for port object a95128b4-a01f-412c-b4d9-9d6e78a05ae9 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:27:21.418186 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.471535 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Pushing event updated for resources: {'Port': ['ID=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:21.534277 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.556539 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Attempting to bind port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:27:21.556897 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Attempting to bind port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:27:21.557336 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Attempting to bind port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 on network c03637ab-b657-4c86-ac98-370101bc4e03 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:27:21.562577 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 on network c03637ab-b657-4c86-ac98-370101bc4e03 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:27:21.562901 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Attempting to bind port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 on network c03637ab-b657-4c86-ac98-370101bc4e03 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:27:21.568532 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 27, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:27:21.568863 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Checking segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:27:21.569241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Bound using segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:27:21.569694 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Bound port: a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:27:21.570050 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.594727 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.640241 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] For port a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:27:21.644100 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] For port a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:27:21.649221 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.684207 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:21.684863 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:21.686288 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] 10.222.0.11 "PUT /v2.0/ports/a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 1094 time: 0.7775459 Nov 16 03:27:21.686736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:21.689160 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab9c0031-e8e3-4698-94dc-2779e07632a7" -d '{"events": [{"name": "network-changed", "server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:21.716600 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9a086e-0d8a-464e-bb8c-7e5d385438d5 service neutron] Pushing event updated for resources: {'Port': ['ID=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:21.752362 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ed65127-f6e9-4bd5-958c-187412dda046 x-openstack-request-id: req-9ed65127-f6e9-4bd5-958c-187412dda046 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:21.752638 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:21.752882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9ed65127-f6e9-4bd5-958c-187412dda046 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:21.753290 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'status': 'completed', 'code': 200} Nov 16 03:27:21.815063 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-5dc94303-7829-4aca-b46a-ef5786f54f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:21.816711 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-5dc94303-7829-4aca-b46a-ef5786f54f32 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1097 time: 0.0522346 Nov 16 03:27:21.866754 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-e855f260-8611-4cac-b7cb-1571497bc678 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 217 time: 0.0358050 Nov 16 03:27:21.919218 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-11641b29-ceae-4d45-9fb5-023488ed92d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:21.920656 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-11641b29-ceae-4d45-9fb5-023488ed92d3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0474558 Nov 16 03:27:21.975665 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-8992fa60-878b-4000-a10d-8cd7d3834d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:21.977629 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-8992fa60-878b-4000-a10d-8cd7d3834d6a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0489559 Nov 16 03:27:22.084751 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-adf7902d-87f5-4d61-a666-273dd2121231 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0996523 Nov 16 03:27:22.184891 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a4698041-0752-4c5a-b3db-fa0480ae5326 req-7874bac8-79b5-431d-bd7b-23141d8cfa05 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927215 Nov 16 03:27:22.320777 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-eadeffd4-5f76-4121-aa1a-365e63d42fc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:22.322413 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-eadeffd4-5f76-4121-aa1a-365e63d42fc7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1097 time: 0.0459030 Nov 16 03:27:22.429632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-8e22f22d-3b74-49ef-8bcb-cad7f075df16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:22.431052 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-8e22f22d-3b74-49ef-8bcb-cad7f075df16 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.1007605 Nov 16 03:27:22.481206 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-306ead66-ff47-4df4-b966-b9cc8c2e03be service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 217 time: 0.0368011 Nov 16 03:27:22.526782 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a804b65-a486-4588-9f79-8f89349336f8 req-4b3d9ab4-2d52-4100-8bdd-2ff210ab93ee tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:22.528244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a804b65-a486-4588-9f79-8f89349336f8 req-4b3d9ab4-2d52-4100-8bdd-2ff210ab93ee tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 944 time: 0.1153197 Nov 16 03:27:22.553718 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-ea427ddb-b172-429a-a51c-ed144cadf619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:22.555131 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-ea427ddb-b172-429a-a51c-ed144cadf619 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0662553 Nov 16 03:27:22.611393 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6a804b65-a486-4588-9f79-8f89349336f8 req-85935bce-abb5-4263-b5f4-0fbe133f8eb4 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0764289 Nov 16 03:27:22.623400 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-99e78670-651c-44e1-8e6e-7a9496db845c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:22.625061 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-99e78670-651c-44e1-8e6e-7a9496db845c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0619538 Nov 16 03:27:22.718914 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-3c743902-dd43-4f8f-91f0-0d83b7cdd205 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856349 Nov 16 03:27:22.817574 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab9c0031-e8e3-4698-94dc-2779e07632a7 req-e218bbe0-4ef8-4885-bd14-fe5c99cfb778 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886447 Nov 16 03:27:23.745285 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af3356f-ca1c-45bc-a136-143278ec2303 req-9f799574-a4e7-4bcd-9107-66161afc8425 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:23.746831 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3af3356f-ca1c-45bc-a136-143278ec2303 req-9f799574-a4e7-4bcd-9107-66161afc8425 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 944 time: 0.0619195 Nov 16 03:27:23.818467 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3af3356f-ca1c-45bc-a136-143278ec2303 req-05d84bed-4864-48fe-88ed-4b5a797fdd89 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602784 Nov 16 03:27:24.380465 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a95128b4-a01f-412c-b4d9-9d6e78a05ae9 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:27:24.487672 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:24.499393 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'port_id': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'mac_address': 'fa:16:3e:58:72:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 317, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:27:24.540925 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:24.554125 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a95128b4-a01f-412c-b4d9-9d6e78a05ae9 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:27:24.576534 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:24.582639 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:24.636950 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:24.906620 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['a95128b4-a01f-412c-b4d9-9d6e78a05ae9'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:27:24.936733 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f81f733-270d-40a3-ad33-e429e0d7fa40 req-97f810c2-8a6e-474e-94b3-efd262d5e99a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:24.938291 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f81f733-270d-40a3-ad33-e429e0d7fa40 req-97f810c2-8a6e-474e-94b3-efd262d5e99a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 945 time: 0.0497570 Nov 16 03:27:24.984744 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8f81f733-270d-40a3-ad33-e429e0d7fa40 req-25add45e-9cde-4ba4-a9f4-112e90a2a9d6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401506 Nov 16 03:27:26.119764 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6f794b-d0aa-4e3c-a581-4e39863bf870 req-69a302e1-8058-44d3-9200-7082a1c1df94 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:26.121134 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bf6f794b-d0aa-4e3c-a581-4e39863bf870 req-69a302e1-8058-44d3-9200-7082a1c1df94 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 945 time: 0.0675790 Nov 16 03:27:26.175787 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bf6f794b-d0aa-4e3c-a581-4e39863bf870 req-bb9f2411-1da1-4c06-8c43-fec5414c7a30 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481408 Nov 16 03:27:26.327709 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50596) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:26.411926 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a95128b4-a01f-412c-b4d9-9d6e78a05ae9 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:27:26.467354 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:27:26.473242 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:27:26.473662 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.497727 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Deleting port 2909a0a2-5d54-4e77-b72d-2772edb1f772 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:26.498044 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.553235 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.581496 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:26.582370 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.582701 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.583715 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-638cb108-93d5-4331-bbc5-a1fd1e9d1960" -d '{"events": [{"server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "name": "network-vif-plugged", "status": "completed", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:26.594740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Calling delete_port for 2909a0a2-5d54-4e77-b72d-2772edb1f772 owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:26.597347 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:26.602780 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.629540 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-faf74b34-e929-4b13-818c-743568ecc1df x-openstack-request-id: req-faf74b34-e929-4b13-818c-743568ecc1df {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:26.629831 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "name": "network-vif-plugged", "status": "completed", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:26.630063 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-faf74b34-e929-4b13-818c-743568ecc1df {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:26.630442 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'code': 200} Nov 16 03:27:26.789761 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.794953 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:26.826631 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'Port': ['ID=2909a0a2-5d54-4e77-b72d-2772edb1f772,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:26.901628 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46812a4f-16d5-4594-be0e-010aa33536cf req-6dc5b404-e8ef-4483-85e7-637909c53297 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:26.903193 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46812a4f-16d5-4594-be0e-010aa33536cf req-6dc5b404-e8ef-4483-85e7-637909c53297 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1099 time: 0.0867088 Nov 16 03:27:26.908293 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:26.908615 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Floating IP 4c2589ff-bedc-491e-9f92-4042030e3da1 disassociated (deleted). External IP: 172.27.1.5, port: a66777b3-94bc-425f-97ce-88f5c1d71349. Nov 16 03:27:27.019319 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-46812a4f-16d5-4594-be0e-010aa33536cf req-564b812f-b81e-409f-aa71-fa1821c629bb service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076975 Nov 16 03:27:27.140725 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:27.258861 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:27.263893 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:27.272154 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:27.283296 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:27.283906 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:27.311834 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-c1c68716-2d41-4b62-8e4e-5ed352149b65 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "DELETE /v2.0/floatingips/4c2589ff-bedc-491e-9f92-4042030e3da1 HTTP/1.1" status: 204 len: 168 time: 0.9829743 Nov 16 03:27:27.313188 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:27.315639 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65" -d '{"events": [{"name": "network-changed", "server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:27.331042 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1765090f-0e01-4f5e-8519-9145d3805d87 req-63ba445f-d801-4d25-a6ea-d953a5b1dc8e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:27.332803 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1765090f-0e01-4f5e-8519-9145d3805d87 req-63ba445f-d801-4d25-a6ea-d953a5b1dc8e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0854595 Nov 16 03:27:27.386895 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1765090f-0e01-4f5e-8519-9145d3805d87 req-a57e8812-c742-460a-8bd0-ff856313f6fa tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466447 Nov 16 03:27:27.390544 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:27.435484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7f26d7d-f30d-4643-a7f4-dbcf107c2bc9 x-openstack-request-id: req-c7f26d7d-f30d-4643-a7f4-dbcf107c2bc9 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:27.436046 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:27.436541 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c7f26d7d-f30d-4643-a7f4-dbcf107c2bc9 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:27.437280 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'status': 'completed', 'code': 200} Nov 16 03:27:27.584328 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a654fb9e-a1f5-444b-bad1-a336d9b6a842 req-a69a92f7-7c00-4315-923c-d4e4020e982a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:27.586004 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a654fb9e-a1f5-444b-bad1-a336d9b6a842 req-a69a92f7-7c00-4315-923c-d4e4020e982a tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 945 time: 0.0755467 Nov 16 03:27:27.593087 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-d3a42432-05e2-442d-bab5-05a7806a7151 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:27.594875 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-d3a42432-05e2-442d-bab5-05a7806a7151 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 1098 time: 0.0725782 Nov 16 03:27:27.723047 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:58Z', 'revision_number': 1, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:27.752478 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:27.761670 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:27.762299 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:27.875788 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:27.959473 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a654fb9e-a1f5-444b-bad1-a336d9b6a842 req-80dab7b6-31d4-4543-9ddf-584be09c4724 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3638155 Nov 16 03:27:27.990460 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-ad926d85-513b-44e5-9ee0-54c46d948bc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:27.991824 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-ad926d85-513b-44e5-9ee0-54c46d948bc8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.3827074 Nov 16 03:27:28.037679 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-ce2e113e-25da-4695-937d-e82d651dc3c0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a66777b3-94bc-425f-97ce-88f5c1d71349 HTTP/1.1" status: 200 len: 217 time: 0.0381529 Nov 16 03:27:28.108654 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:58Z', 'revision_number': 1, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:28.113470 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-e0f34694-2049-4663-9538-179617701c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:28.114951 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-e0f34694-2049-4663-9538-179617701c1f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0473261 Nov 16 03:27:28.135207 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4523cc5-cb24-4db7-b46f-1c59d23c7f7e None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': 'a7808eec-cf97-4b52-98c8-df3a500d6adb', 'tenant_id': 'f0e656658949487fb898565d34636908', 'floating_ip_address': '172.27.1.185', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'port_id': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'mac_address': 'fa:16:3e:0d:28:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:23:55Z', 'updated_at': '2021-11-16T03:23:58Z', 'revision_number': 1, 'project_id': 'f0e656658949487fb898565d34636908', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:28.178258 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-05904b3a-3a45-4e39-919a-bbe4f21b8087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:28.179894 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-05904b3a-3a45-4e39-919a-bbe4f21b8087 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0447273 Nov 16 03:27:28.293310 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-916f049d-183a-4fda-aed0-22741ba8d7a1 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920146 Nov 16 03:27:28.390772 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-544660f7-66b5-4070-aac9-8af6d1def6f9 None None] New status for floating IP 4c2589ff-bedc-491e-9f92-4042030e3da1: DOWN {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:27:28.402863 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ab52e73c-7ce9-4776-b37f-db3e8a4aec65 req-a764a980-82ad-4051-8621-5f8f7fced253 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884137 Nov 16 03:27:28.517881 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a765f00c-a9ce-411d-9805-fd99a193b375 req-13d6696b-cf4f-4661-a7dc-85f254c19882 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:28.519278 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a765f00c-a9ce-411d-9805-fd99a193b375 req-13d6696b-cf4f-4661-a7dc-85f254c19882 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0548763 Nov 16 03:27:28.577045 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a765f00c-a9ce-411d-9805-fd99a193b375 req-27c27e74-2913-4069-9c93-6d12e2fe759a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517125 Nov 16 03:27:28.702120 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f15f16-4ad9-4465-932d-cf443750ea2b req-67a76db8-6b5d-40e9-9ddc-9196c79d5aa1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:28.703630 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-09f15f16-4ad9-4465-932d-cf443750ea2b req-67a76db8-6b5d-40e9-9ddc-9196c79d5aa1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0601153 Nov 16 03:27:28.712724 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50612) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:28.717264 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'floatingip': {'port_id': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:27:28.755939 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:29.163887 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c15d1099-449a-4cb8-8c90-f3dc1d180149 req-06a8296c-6bbf-4b2c-9513-c00786ca7f8e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:29.165296 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c15d1099-449a-4cb8-8c90-f3dc1d180149 req-06a8296c-6bbf-4b2c-9513-c00786ca7f8e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 945 time: 0.1142344 Nov 16 03:27:29.266163 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:29.272160 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c15d1099-449a-4cb8-8c90-f3dc1d180149 req-508cb13a-e9c4-4080-971a-776057be3a86 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0986755 Nov 16 03:27:29.273363 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:29.379502 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Floating IP 0d621c77-450c-41e1-8ede-1a1506cfa1c9 associated. External IP: 172.27.1.15, port: a95128b4-a01f-412c-b4d9-9d6e78a05ae9. Nov 16 03:27:29.521568 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9928305e-1da2-43f7-8d49-66042a13135c req-ae886efb-2ba8-4c64-9524-d212a406bc82 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:29.522992 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9928305e-1da2-43f7-8d49-66042a13135c req-ae886efb-2ba8-4c64-9524-d212a406bc82 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 945 time: 0.0709524 Nov 16 03:27:29.690832 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Router 434fedcd-dbea-44e4-b250-de8dc3af705a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:29.705357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Deleting port a66777b3-94bc-425f-97ce-88f5c1d71349 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:29.705774 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:29.873513 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] For port a66777b3-94bc-425f-97ce-88f5c1d71349, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a66777b3-94bc-425f-97ce-88f5c1d71349,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:29.873904 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:29.888205 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:29.889977 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Calling delete_port for a66777b3-94bc-425f-97ce-88f5c1d71349 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:29.894044 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:29.899537 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:29.910581 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:29.911195 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:29.958311 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a5bf0f3d-d0ff-4d94-b8ee-62092d709a52 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "PUT /v2.0/floatingips/0d621c77-450c-41e1-8ede-1a1506cfa1c9 HTTP/1.1" status: 200 len: 991 time: 1.2444639 Nov 16 03:27:29.960297 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:29.962718 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-546e79a9-66c6-40b1-952b-6aa161125ff3" -d '{"events": [{"name": "network-changed", "server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:30.025813 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-418f1440-0ea0-413f-a321-7477f9e7bc8d x-openstack-request-id: req-418f1440-0ea0-413f-a321-7477f9e7bc8d {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:30.026081 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:30.026307 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-418f1440-0ea0-413f-a321-7477f9e7bc8d {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:30.026704 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'status': 'completed', 'code': 200} Nov 16 03:27:30.032633 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:30.056751 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:30.097561 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'Port': ['ID=a66777b3-94bc-425f-97ce-88f5c1d71349,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:30.166443 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] No DVR routers for this DVR port a66777b3-94bc-425f-97ce-88f5c1d71349 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:30.169871 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:30.173283 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9928305e-1da2-43f7-8d49-66042a13135c req-3fa081ff-2f94-4c8b-a845-0770632dd9a8 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "DELETE /v2.0/ports/a66777b3-94bc-425f-97ce-88f5c1d71349 HTTP/1.1" status: 204 len: 173 time: 0.6130800 Nov 16 03:27:30.178126 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-55130187-4b9a-437a-b48d-49d1227eda9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:30.179666 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-55130187-4b9a-437a-b48d-49d1227eda9a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1099 time: 0.0902231 Nov 16 03:27:30.279542 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '0d621c77-450c-41e1-8ede-1a1506cfa1c9', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'floating_ip_address': '172.27.1.15', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'port_id': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'mac_address': 'fa:16:3e:58:72:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:27:17Z', 'updated_at': '2021-11-16T03:27:29Z', 'revision_number': 1, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:30.288689 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-aa53d630-1b2f-4442-8440-c57b0b312971 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:30.290185 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-aa53d630-1b2f-4442-8440-c57b0b312971 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.1026487 Nov 16 03:27:30.309902 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:30.318797 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:30.319405 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:30.374371 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b02dbb09-8bbb-4d7a-bfe8-cdf7ba95a495 req-02e1da36-0ea3-438b-a064-d794eab5dace tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f69f87d-b041-4f97-9426-81f0e965939c HTTP/1.1" status: 200 len: 210 time: 0.0316303 Nov 16 03:27:30.379666 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-fa6b7dd9-eada-47b6-a957-476be4737ddc service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 999 time: 0.0817392 Nov 16 03:27:30.422791 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:30.434144 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-1fec566b-71e6-4ae2-9cc8-3921fd41e16f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:30.435782 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-1fec566b-71e6-4ae2-9cc8-3921fd41e16f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0486994 Nov 16 03:27:30.493416 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-50c09070-ecbb-46d4-a3fe-3c61b1e1f426 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:30.494969 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-50c09070-ecbb-46d4-a3fe-3c61b1e1f426 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0510919 Nov 16 03:27:30.614492 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-fd1cb81d-098e-4370-a0db-0c7e55981e76 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1106727 Nov 16 03:27:30.695391 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '0d621c77-450c-41e1-8ede-1a1506cfa1c9', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'floating_ip_address': '172.27.1.15', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'port_id': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'mac_address': 'fa:16:3e:58:72:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:27:17Z', 'updated_at': '2021-11-16T03:27:29Z', 'revision_number': 1, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:30.714659 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546e79a9-66c6-40b1-952b-6aa161125ff3 req-37b606fa-53c5-4b88-bd59-11ad3107688f service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927234 Nov 16 03:27:30.728030 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e284dd49-3273-4f4b-97cf-733431e353ad None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '0d621c77-450c-41e1-8ede-1a1506cfa1c9', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'floating_ip_address': '172.27.1.15', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'port_id': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'mac_address': 'fa:16:3e:58:72:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:27:17Z', 'updated_at': '2021-11-16T03:27:29Z', 'revision_number': 1, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:30.942617 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e5a925-817e-4453-8798-591f28c4c35a None None] New status for floating IP 0d621c77-450c-41e1-8ede-1a1506cfa1c9: ACTIVE {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:27:32.028011 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'name': 'network-vif-deleted', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:32.030427 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd4521be-de2f-4e92-ab6d-9ebd14aa32f3" -d '{"events": [{"server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "name": "network-vif-deleted", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:32.068666 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be306c52-205f-4cfb-a69a-b753c95f5618 x-openstack-request-id: req-be306c52-205f-4cfb-a69a-b753c95f5618 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:32.068951 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f69f87d-b041-4f97-9426-81f0e965939c", "name": "network-vif-deleted", "tag": "a66777b3-94bc-425f-97ce-88f5c1d71349", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:32.069199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-be306c52-205f-4cfb-a69a-b753c95f5618 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:32.069618 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f69f87d-b041-4f97-9426-81f0e965939c', 'name': 'network-vif-deleted', 'tag': 'a66777b3-94bc-425f-97ce-88f5c1d71349', 'status': 'completed', 'code': 200} Nov 16 03:27:32.142488 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:27:33.667740 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50644) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:33.833905 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Deleting port 2d3a92f0-21fd-44ae-8b6e-177fe3cf7561 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:33.834246 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:33.914746 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:33.914988 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:33.927493 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Calling delete_port for 2d3a92f0-21fd-44ae-8b6e-177fe3cf7561 owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:34.079830 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:34.105366 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'Port': ['ID=2d3a92f0-21fd-44ae-8b6e-177fe3cf7561,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:34.165701 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:34.166219 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Floating IP a7808eec-cf97-4b52-98c8-df3a500d6adb disassociated (deleted). External IP: 172.27.1.185, port: e037ab2a-67a2-4571-bb58-938a1ea5e8c9. Nov 16 03:27:34.389364 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:34.429721 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a66777b3-94bc-425f-97ce-88f5c1d71349 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:34.450123 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: a66777b3-94bc-425f-97ce-88f5c1d71349 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:34.450484 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a66777b3-94bc-425f-97ce-88f5c1d71349 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:34.765474 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:34.770876 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:34.776778 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:34.788748 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:34.789525 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:34.798086 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-c988da6c-de86-44c5-ae0f-cd01178d304b tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "DELETE /v2.0/floatingips/a7808eec-cf97-4b52-98c8-df3a500d6adb HTTP/1.1" status: 204 len: 168 time: 1.1292350 Nov 16 03:27:34.798623 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:34.801513 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a479061-ea21-45cb-be57-bf6f52c40f69" -d '{"events": [{"name": "network-changed", "server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:34.841721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c222ecbf-f708-447d-aa62-19c448e55a60 x-openstack-request-id: req-c222ecbf-f708-447d-aa62-19c448e55a60 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:34.842082 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:34.842362 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c222ecbf-f708-447d-aa62-19c448e55a60 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:34.842713 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'status': 'completed', 'code': 200} Nov 16 03:27:34.931012 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-ea218ce5-bfdc-4735-82fd-f2b833757984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:34.932561 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-ea218ce5-bfdc-4735-82fd-f2b833757984 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f0e656658949487fb898565d34636908&device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 1098 time: 0.0455649 Nov 16 03:27:35.003354 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:35.070124 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-6c15188a-b5ba-4b84-ba63-946b43a381d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:35.071496 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-6c15188a-b5ba-4b84-ba63-946b43a381d3 service neutron] 10.222.0.11 "GET /v2.0/networks?id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 200 len: 913 time: 0.1295886 Nov 16 03:27:35.079799 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546aecca-42ad-4c34-a19b-6f673ad13c6f req-29fe9966-c26c-441b-a9d4-16d200cf2cd2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:35.081254 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546aecca-42ad-4c34-a19b-6f673ad13c6f req-29fe9966-c26c-441b-a9d4-16d200cf2cd2 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 945 time: 0.0776742 Nov 16 03:27:35.121148 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-43f582f0-ef10-476e-b373-06ca075f1828 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 200 len: 217 time: 0.0388746 Nov 16 03:27:35.196815 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-546aecca-42ad-4c34-a19b-6f673ad13c6f req-b711d672-fd0a-4a00-887e-41074a3d4c49 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1090364 Nov 16 03:27:35.198357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-18a4c7dd-d462-4b0a-a439-891f3c432db0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:35.199709 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-18a4c7dd-d462-4b0a-a439-891f3c432db0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 200 len: 851 time: 0.0695689 Nov 16 03:27:35.202456 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:35.232690 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:35.241016 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:35.241653 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:35.248919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-f02e5230-a633-4942-b10a-63ce131299ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:35.250472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-f02e5230-a633-4942-b10a-63ce131299ff service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=47ea8a48-7e03-48bf-883e-ab437cbcd3a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0425429 Nov 16 03:27:35.349488 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:35.349710 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-6c6263be-1ebc-4edb-a21d-b9ab06a7ac84 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893641 Nov 16 03:27:35.446988 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4a479061-ea21-45cb-be57-bf6f52c40f69 req-10c534ce-4a36-4523-ba84-0f9fdbec75d5 service neutron] 10.222.0.11 "GET /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896504 Nov 16 03:27:35.557465 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:35.588428 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4120a8ef-d85d-4ef1-9b49-09dd8f0e0b0f None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:19:42Z', 'revision_number': 4, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '78dd7ed6-d615-48fd-9062-5608943ec7cc', 'name': '', 'network_id': '47ea8a48-7e03-48bf-883e-ab437cbcd3a0', 'tenant_id': 'f0e656658949487fb898565d34636908', 'mac_address': 'fa:16:3e:76:30:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:41Z', 'updated_at': '2021-11-16T03:19:47Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'subnets': [{'id': '5adb8701-919b-407f-b696-94dbe3d5e70a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:35.844280 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66453cfb-e621-41fd-8a39-ccebce64a0d9 None None] New status for floating IP a7808eec-cf97-4b52-98c8-df3a500d6adb: DOWN {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:27:35.948604 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:36.336092 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a497c764-f812-4ca5-bdbe-c08ada32fc1a req-38908c82-e76f-4f56-9174-cc4f3ec34126 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:36.337614 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a497c764-f812-4ca5-bdbe-c08ada32fc1a req-38908c82-e76f-4f56-9174-cc4f3ec34126 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 945 time: 0.0655162 Nov 16 03:27:36.391677 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a497c764-f812-4ca5-bdbe-c08ada32fc1a req-d67bffba-3181-49f7-807a-2e5cd04257c9 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/security-groups?id=b3b2cefa-a732-4c2d-8879-25a8537d518a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481603 Nov 16 03:27:36.739676 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-1192cd38-5774-4590-94b8-f3c623f6159e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:36.743047 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-1192cd38-5774-4590-94b8-f3c623f6159e tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 945 time: 0.0582581 Nov 16 03:27:36.867603 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Deleting port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:36.867964 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:36.966808 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] For port e037ab2a-67a2-4571-bb58-938a1ea5e8c9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:36.967047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:36.980138 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Calling delete_port for e037ab2a-67a2-4571-bb58-938a1ea5e8c9 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:37.120782 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:37.151450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'Port': ['ID=e037ab2a-67a2-4571-bb58-938a1ea5e8c9,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:37.191458 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] No DVR routers for this DVR port e037ab2a-67a2-4571-bb58-938a1ea5e8c9 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:37.194089 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:37.197340 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7576e19-5760-41ff-a8c4-b8909e4a17aa req-eeb7cc80-e11a-4236-b4ef-cb5ab0d36186 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.11 "DELETE /v2.0/ports/e037ab2a-67a2-4571-bb58-938a1ea5e8c9 HTTP/1.1" status: 204 len: 173 time: 0.4339569 Nov 16 03:27:37.197814 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'name': 'network-vif-deleted', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:37.200060 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2763a20-c1a8-455c-85e8-b0448129bfd1" -d '{"events": [{"server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "name": "network-vif-deleted", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:37.247476 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-72f7bccd-f848-4b25-90f1-5de6227bf9de x-openstack-request-id: req-72f7bccd-f848-4b25-90f1-5de6227bf9de {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:37.247735 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a24c663-6035-48f0-a30f-7b1a8787b7bb", "name": "network-vif-deleted", "tag": "e037ab2a-67a2-4571-bb58-938a1ea5e8c9", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:37.247979 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-72f7bccd-f848-4b25-90f1-5de6227bf9de {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:37.248397 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a24c663-6035-48f0-a30f-7b1a8787b7bb', 'name': 'network-vif-deleted', 'tag': 'e037ab2a-67a2-4571-bb58-938a1ea5e8c9', 'status': 'completed', 'code': 200} Nov 16 03:27:37.502848 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-96bf1362-0a8b-43fd-a3a4-50ec8152fd78 req-7ebdc6da-659a-4962-8ebb-51d30509ffd6 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "GET /v2.0/ports?device_id=0a24c663-6035-48f0-a30f-7b1a8787b7bb HTTP/1.1" status: 200 len: 210 time: 0.0272655 Nov 16 03:27:38.565983 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50668) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:38.696160 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Deleting port 753523c1-46d0-4ff5-92f5-93ee7ec1f238 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:38.696453 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:38.780333 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:38.780622 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:38.793611 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Calling delete_port for 753523c1-46d0-4ff5-92f5-93ee7ec1f238 owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:38.942589 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:38.969736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'Port': ['ID=753523c1-46d0-4ff5-92f5-93ee7ec1f238,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:39.039434 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:39.043317 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:39.045413 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-e96eabe0-28a3-4b57-afeb-67a440c9ee91 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "DELETE /v2.0/floatingips/603af913-04dd-45aa-b688-4ca042282370 HTTP/1.1" status: 204 len: 168 time: 0.4780924 Nov 16 03:27:40.254836 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50684) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:40.317916 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-52293453-2a69-48a2-8bfd-150a639f01b1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:40.345103 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-52293453-2a69-48a2-8bfd-150a639f01b1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:40.407679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-52293453-2a69-48a2-8bfd-150a639f01b1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:40.411028 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-52293453-2a69-48a2-8bfd-150a639f01b1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:40.412221 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-52293453-2a69-48a2-8bfd-150a639f01b1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] 10.222.0.31 "DELETE /v2.0/security-groups/b3b2cefa-a732-4c2d-8879-25a8537d518a HTTP/1.1" status: 204 len: 168 time: 0.1564009 Nov 16 03:27:40.421325 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52293453-2a69-48a2-8bfd-150a639f01b1 tempest-TestVolumeBootPattern-1223851883 tempest-TestVolumeBootPattern-1223851883-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3b2cefa-a732-4c2d-8879-25a8537d518a,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:40.439956 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device e037ab2a-67a2-4571-bb58-938a1ea5e8c9 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:40.464781 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: e037ab2a-67a2-4571-bb58-938a1ea5e8c9 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:40.465124 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device e037ab2a-67a2-4571-bb58-938a1ea5e8c9 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:40.469571 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50688) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:40.878373 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:41.148108 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Deleting port 78dd7ed6-d615-48fd-9062-5608943ec7cc {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:41.148536 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:41.237247 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] For port 78dd7ed6-d615-48fd-9062-5608943ec7cc, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=78dd7ed6-d615-48fd-9062-5608943ec7cc,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:41.237835 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:41.254795 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Calling delete_port for 78dd7ed6-d615-48fd-9062-5608943ec7cc owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:41.446858 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:41.476538 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Pushing event deleted for resources: {'Port': ['ID=78dd7ed6-d615-48fd-9062-5608943ec7cc,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:41.645756 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:41.870141 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:41.995685 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:42.001812 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-b21456de-8d0b-4468-a62b-cbfdf99c198c admin admin] 10.222.0.31 "PUT /v2.0/routers/2f54eadc-59f5-4dd8-820b-7d52e3f81a9c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5311201 Nov 16 03:27:42.004726 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50694) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:42.006877 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] Sync routers for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:42.018203 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:42.018839 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:42.109886 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks [] for router, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.125155 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:42.216169 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.275565 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Deleting port 5c47b562-7710-4bbb-b511-1e0092b0cf5e {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:42.275900 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.306327 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:27:41Z', 'revision_number': 5, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port': {'id': '5c47b562-7710-4bbb-b511-1e0092b0cf5e', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:e2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 422, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:38Z', 'updated_at': '2021-11-16T03:19:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:42.332501 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] Checking router: 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:42.341500 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] Routers {'2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:42.342142 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:42.358728 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] For port 5c47b562-7710-4bbb-b511-1e0092b0cf5e, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=5c47b562-7710-4bbb-b511-1e0092b0cf5e,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:42.359070 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.373494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Calling delete_port for 5c47b562-7710-4bbb-b511-1e0092b0cf5e owned by network:router_gateway {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:42.438239 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] Set router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c gateway port host: None {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:42.491885 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:27:42Z', 'revision_number': 6, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port_host': None}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:42.518205 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed07fd57-4024-4416-9886-2dd94776d1b0 None None] The sync data for ids ['2f54eadc-59f5-4dd8-820b-7d52e3f81a9c'] in dv-cinder-818037-1-iscsi is: [{'id': '2f54eadc-59f5-4dd8-820b-7d52e3f81a9c', 'name': 'tempest-TestVolumeBootPattern-1347472510-router', 'tenant_id': 'f0e656658949487fb898565d34636908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:37Z', 'updated_at': '2021-11-16T03:27:42Z', 'revision_number': 6, 'project_id': 'f0e656658949487fb898565d34636908', 'gw_port_host': None}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:42.545958 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.577441 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Pushing event deleted for resources: {'Port': ['ID=5c47b562-7710-4bbb-b511-1e0092b0cf5e,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:42.656309 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.749121 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.751341 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.799357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.800157 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2f54eadc-59f5-4dd8-820b-7d52e3f81a9c {{(pid=101899) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:27:42.804701 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.805935 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4949f365-c584-44c6-a445-0eae860658a7 admin admin] 10.222.0.31 "DELETE /v2.0/routers/2f54eadc-59f5-4dd8-820b-7d52e3f81a9c HTTP/1.1" status: 204 len: 168 time: 0.8002200 Nov 16 03:27:42.808584 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50698) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:42.853484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_v2 [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Deleting subnet 5adb8701-919b-407f-b696-94dbe3d5e70a {{(pid=101899) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:27:42.856944 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:42.897991 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129335955'] for subnet, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.011326 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.077280 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126058139', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126233428'] for subnet, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.103418 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5adb8701-919b-407f-b696-94dbe3d5e70a,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:43.106904 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.110241 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-af18b678-b830-4cfa-ab13-98f3995836a3 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/5adb8701-919b-407f-b696-94dbe3d5e70a HTTP/1.1" status: 204 len: 168 time: 0.3006451 Nov 16 03:27:43.113376 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50700) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:43.115377 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2190e1f1-5a78-4eba-8636-1f460472baee None None] Network 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:27:43.183168 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.239175 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Deleting port 75ee9abc-3389-4b4e-b64f-0161820cde17 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:43.239403 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.305147 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] DHCP port deletion for 47ea8a48-7e03-48bf-883e-ab437cbcd3a0 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:27:43.307008 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] For port 75ee9abc-3389-4b4e-b64f-0161820cde17, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=75ee9abc-3389-4b4e-b64f-0161820cde17,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:43.307382 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.320360 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Calling delete_port for 75ee9abc-3389-4b4e-b64f-0161820cde17 owned by network:dhcp {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:43.352901 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] Deleting port 75ee9abc-3389-4b4e-b64f-0161820cde17 {{(pid=101900) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:43.353579 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.413392 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.423302 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] For port 75ee9abc-3389-4b4e-b64f-0161820cde17, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=75ee9abc-3389-4b4e-b64f-0161820cde17,segment=NetworkSegment(b3df5703-5784-41a7-b817-6be11be04ba5),segment_id=b3df5703-5784-41a7-b817-6be11be04ba5)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:43.423725 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.436699 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] Calling delete_port for 75ee9abc-3389-4b4e-b64f-0161820cde17 owned by network:dhcp {{(pid=101900) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:43.439349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Pushing event deleted for resources: {'Port': ['ID=75ee9abc-3389-4b4e-b64f-0161820cde17,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:43.443292 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] No DVR routers for this DVR port 75ee9abc-3389-4b4e-b64f-0161820cde17 on host dv-cinder-818037-1-iscsi {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:43.525344 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.529940 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765'] for port, after_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.559383 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['47ea8a48-7e03-48bf-883e-ab437cbcd3a0']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:43.560799 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] Pushing event deleted for resources: {'Port': ['ID=75ee9abc-3389-4b4e-b64f-0161820cde17,revision_number=None']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:43.567157 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9ce5d08-453c-42d5-a78f-58bca187bbef None None] No DVR routers for this DVR port 75ee9abc-3389-4b4e-b64f-0161820cde17 on host dv-cinder-818037-1-iscsi {{(pid=101900) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:43.591662 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b3df5703-5784-41a7-b817-6be11be04ba5') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:43.592031 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b3df5703-5784-41a7-b817-6be11be04ba5') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:43.607989 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.622127 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.624351 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 78dd7ed6-d615-48fd-9062-5608943ec7cc no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:43.629228 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Releasing vlan 304 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:27:43.629792 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:27:43.631680 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:27:43.645127 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 78dd7ed6-d615-48fd-9062-5608943ec7cc {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:43.648168 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 78dd7ed6-d615-48fd-9062-5608943ec7cc not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:43.648168 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 5c47b562-7710-4bbb-b511-1e0092b0cf5e no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:43.665417 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 5c47b562-7710-4bbb-b511-1e0092b0cf5e {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:43.666273 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 5c47b562-7710-4bbb-b511-1e0092b0cf5e not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:43.666273 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 75ee9abc-3389-4b4e-b64f-0161820cde17 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:43.685353 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 75ee9abc-3389-4b4e-b64f-0161820cde17 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:43.685811 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 75ee9abc-3389-4b4e-b64f-0161820cde17 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:43.685987 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.691899 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:43.698040 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] 10.222.0.31 "DELETE /v2.0/networks/47ea8a48-7e03-48bf-883e-ab437cbcd3a0 HTTP/1.1" status: 204 len: 168 time: 0.5809271 Nov 16 03:27:43.699233 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50704) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:43.707274 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee751e1-53d9-4b62-8aee-27790c25f651 admin admin] Pushing event deleted for resources: {'Network': ['ID=47ea8a48-7e03-48bf-883e-ab437cbcd3a0,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:44.365393 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:44.366871 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-382f8005-6004-4c6f-9c10-a4effe9a60b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:44.645069 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Deleting port a0899499-351a-4f08-8b71-8a19ab6cda2b {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:44.645321 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:44.735391 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] For port a0899499-351a-4f08-8b71-8a19ab6cda2b, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=a0899499-351a-4f08-8b71-8a19ab6cda2b,segment=NetworkSegment(f08d8d97-7a2b-4489-bc72-282380d6b63a),segment_id=f08d8d97-7a2b-4489-bc72-282380d6b63a)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:44.736130 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:44.749515 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Calling delete_port for a0899499-351a-4f08-8b71-8a19ab6cda2b owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:44.961154 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:44.986782 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Pushing event deleted for resources: {'Port': ['ID=a0899499-351a-4f08-8b71-8a19ab6cda2b,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:45.154798 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:45.391605 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Router 4df3e9d8-80be-4b7b-8046-27014c1ff987 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:45.503017 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:45.508310 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-d13128bf-7f27-4b8b-be19-0b7951c52d5e admin admin] 10.222.0.31 "PUT /v2.0/routers/4df3e9d8-80be-4b7b-8046-27014c1ff987/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8079786 Nov 16 03:27:45.511739 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50708) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:45.514998 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] Sync routers for ids ['4df3e9d8-80be-4b7b-8046-27014c1ff987'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:45.529369 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] Routers {'4df3e9d8-80be-4b7b-8046-27014c1ff987'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:45.530444 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['4df3e9d8-80be-4b7b-8046-27014c1ff987'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:45.626083 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks [] for router, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:45.645061 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] Set router 4df3e9d8-80be-4b7b-8046-27014c1ff987 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:45.735421 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:45.796963 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Deleting port 90b8edf2-7453-412e-9292-0ff80b7cd3e1 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:45.797416 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:45.840821 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:27:44Z', 'revision_number': 5, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port': {'id': '90b8edf2-7453-412e-9292-0ff80b7cd3e1', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:2e:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'device_owner': 'network:router_gateway', 'standard_attr_id': 434, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:19:46Z', 'updated_at': '2021-11-16T03:19:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:45.870666 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] Checking router: 4df3e9d8-80be-4b7b-8046-27014c1ff987 for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:45.878437 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] For port 90b8edf2-7453-412e-9292-0ff80b7cd3e1, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=90b8edf2-7453-412e-9292-0ff80b7cd3e1,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:45.878744 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:45.879577 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] Routers {'4df3e9d8-80be-4b7b-8046-27014c1ff987'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:45.880193 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['4df3e9d8-80be-4b7b-8046-27014c1ff987'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:45.896547 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Calling delete_port for 90b8edf2-7453-412e-9292-0ff80b7cd3e1 owned by network:router_gateway {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:45.963930 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] Set router 4df3e9d8-80be-4b7b-8046-27014c1ff987 gateway port host: None {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:46.017345 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:27:45Z', 'revision_number': 6, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port_host': None}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:46.044810 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8a861c3-4aaa-4ded-a902-f8c0cd0f8e84 None None] The sync data for ids ['4df3e9d8-80be-4b7b-8046-27014c1ff987'] in dv-cinder-818037-1-iscsi is: [{'id': '4df3e9d8-80be-4b7b-8046-27014c1ff987', 'name': 'tempest-TestVolumeBootPattern-1991510355-router', 'tenant_id': 'f616d231885846a299f65758235aaa76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:19:45Z', 'updated_at': '2021-11-16T03:27:45Z', 'revision_number': 6, 'project_id': 'f616d231885846a299f65758235aaa76', 'gw_port_host': None}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:46.057893 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.087701 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Pushing event deleted for resources: {'Port': ['ID=90b8edf2-7453-412e-9292-0ff80b7cd3e1,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:46.148923 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.241843 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.244160 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.296192 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.297133 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4df3e9d8-80be-4b7b-8046-27014c1ff987 {{(pid=101898) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:27:46.303615 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.305971 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c843173a-2d56-465d-aef1-05ef538e6ac3 admin admin] 10.222.0.31 "DELETE /v2.0/routers/4df3e9d8-80be-4b7b-8046-27014c1ff987 HTTP/1.1" status: 204 len: 168 time: 0.7926309 Nov 16 03:27:46.309020 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50712) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:46.358455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_v2 [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Deleting subnet 7546ff7f-8540-45b0-b867-f6a1fceb9e4c {{(pid=101899) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:27:46.361815 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.403269 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129335955'] for subnet, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.490301 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.547265 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126058139', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126233428'] for subnet, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.572949 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7546ff7f-8540-45b0-b867-f6a1fceb9e4c,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:46.576710 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.580824 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7178c4d2-950c-4a54-8fc9-861eef5c3876 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/7546ff7f-8540-45b0-b867-f6a1fceb9e4c HTTP/1.1" status: 204 len: 168 time: 0.2686543 Nov 16 03:27:46.582470 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50714) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:46.585735 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b6a1552-afaf-42a4-bc9a-9838c69ff487 None None] Network b1af4650-1ff7-4f03-957a-4c5c8ba142c1 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:27:46.656196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.710326 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Deleting port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:46.710650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.780216 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] For port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,segment=NetworkSegment(f08d8d97-7a2b-4489-bc72-282380d6b63a),segment_id=f08d8d97-7a2b-4489-bc72-282380d6b63a)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:46.780602 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.797308 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Calling delete_port for 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 owned by network:dhcp {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:46.816485 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] DHCP port deletion for b1af4650-1ff7-4f03-957a-4c5c8ba142c1 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:27:46.891340 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.899269 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Deleting port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 {{(pid=101900) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:46.900123 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.919709 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Pushing event deleted for resources: {'Port': ['ID=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:46.921710 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] No DVR routers for this DVR port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 on host dv-cinder-818037-1-iscsi {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:46.974274 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] For port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63, host dv-cinder-818037-1-iscsi, got binding levels [] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:46.974668 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.987505 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Calling delete_port for 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 owned by network:dhcp {{(pid=101900) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:46.990449 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.ipam_backend_mixin [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 was not found and therefore no delete operation was performed {{(pid=101900) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 16 03:27:46.991812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765'] for port, after_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:46.995092 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.016768 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b1af4650-1ff7-4f03-957a-4c5c8ba142c1']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:47.018380 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] Pushing event deleted for resources: {'Port': ['ID=4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63,revision_number=None']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:47.022056 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c21d9b-ec15-4a75-9862-37fde36eaa3d None None] No DVR routers for this DVR port 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 on host dv-cinder-818037-1-iscsi {{(pid=101900) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:47.034801 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f08d8d97-7a2b-4489-bc72-282380d6b63a') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:47.035097 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f08d8d97-7a2b-4489-bc72-282380d6b63a') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:47.044847 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.058804 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.065811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Releasing vlan 335 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:27:47.066211 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:27:47.068046 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:27:47.123391 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.129301 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.132589 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] 10.222.0.31 "DELETE /v2.0/networks/b1af4650-1ff7-4f03-957a-4c5c8ba142c1 HTTP/1.1" status: 204 len: 168 time: 0.5491776 Nov 16 03:27:47.144056 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084db686-d38e-4f7c-abb1-a4414480cdef admin admin] Pushing event deleted for resources: {'Network': ['ID=b1af4650-1ff7-4f03-957a-4c5c8ba142c1,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:47.254603 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50720) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:47.299306 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-3b970a07-b317-46dd-8c6d-ff11276cdb08 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=f0e656658949487fb898565d34636908&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0433846 Nov 16 03:27:47.302260 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50722) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:47.348450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7cc6e410-4d6d-47dc-9c17-52fde75cc31f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.373809 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7cc6e410-4d6d-47dc-9c17-52fde75cc31f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.424581 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7cc6e410-4d6d-47dc-9c17-52fde75cc31f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.427356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-7cc6e410-4d6d-47dc-9c17-52fde75cc31f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.428506 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-7cc6e410-4d6d-47dc-9c17-52fde75cc31f admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/2d1645fc-b210-4a09-bd1b-799defa19491 HTTP/1.1" status: 204 len: 168 time: 0.1253402 Nov 16 03:27:47.436445 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc6e410-4d6d-47dc-9c17-52fde75cc31f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d1645fc-b210-4a09-bd1b-799defa19491,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:47.600120 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 90b8edf2-7453-412e-9292-0ff80b7cd3e1 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:47.629041 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 90b8edf2-7453-412e-9292-0ff80b7cd3e1 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:47.629381 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 90b8edf2-7453-412e-9292-0ff80b7cd3e1 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:47.629809 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:47.649277 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:47.649646 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 4d1c1bb0-ac35-4d0f-8ca6-6fdeb059db63 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:47.650056 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a0899499-351a-4f08-8b71-8a19ab6cda2b no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:47.668957 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: a0899499-351a-4f08-8b71-8a19ab6cda2b {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:47.669301 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device a0899499-351a-4f08-8b71-8a19ab6cda2b not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:47.780276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50728) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:47.821787 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-2d21a129-083d-490f-aaee-ff34b97b161a admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=f616d231885846a299f65758235aaa76&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0402975 Nov 16 03:27:47.824393 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50730) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:47.877892 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-45156aa5-6e95-4f14-94e7-650830f47636 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.901473 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-45156aa5-6e95-4f14-94e7-650830f47636 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.956721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-45156aa5-6e95-4f14-94e7-650830f47636 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.959531 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-45156aa5-6e95-4f14-94e7-650830f47636 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:47.960736 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-45156aa5-6e95-4f14-94e7-650830f47636 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/8b861dd2-5a05-4003-bea4-240afec8d0fc HTTP/1.1" status: 204 len: 168 time: 0.1353102 Nov 16 03:27:47.969410 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45156aa5-6e95-4f14-94e7-650830f47636 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b861dd2-5a05-4003-bea4-240afec8d0fc,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:48.456512 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-773ada3b-b3a6-4ed3-b453-03a7c6b09a4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:49.809206 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:50.073883 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50740) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:50.242748 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Deleting port 9a78e600-5b35-4316-96be-fbc4bd8adc68 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:50.243084 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:50.322384 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:50.322667 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:50.334423 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Calling delete_port for 9a78e600-5b35-4316-96be-fbc4bd8adc68 owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:50.494706 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:50.519972 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event deleted for resources: {'Port': ['ID=9a78e600-5b35-4316-96be-fbc4bd8adc68,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:50.586087 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:50.586346 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Floating IP e553aab9-91a2-4f73-91d4-0a64f7bc2eed disassociated (deleted). External IP: 172.27.1.6, port: 338936ea-fa25-4065-9970-6d7171659768. Nov 16 03:27:51.067806 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Router 95164b65-5103-4ebd-944c-7883a34b1f32 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:51.179432 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:51.184631 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:51.190232 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] Sync routers for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:51.201036 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:51.201683 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:51.212577 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a38b61d6-d179-43ab-9961-18b1f102f4f5 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "DELETE /v2.0/floatingips/e553aab9-91a2-4f73-91d4-0a64f7bc2eed HTTP/1.1" status: 204 len: 168 time: 1.1376352 Nov 16 03:27:51.213385 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:51.215882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c307abf-3e02-4084-87e5-8ddd0a086a33" -d '{"events": [{"name": "network-changed", "server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:51.314418 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:51.355131 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50c9c4eb-fcdf-4291-8649-abda14de843a x-openstack-request-id: req-50c9c4eb-fcdf-4291-8649-abda14de843a {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:51.355494 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "tag": "338936ea-fa25-4065-9970-6d7171659768", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:51.355802 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-50c9c4eb-fcdf-4291-8649-abda14de843a {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:51.356266 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'status': 'completed', 'code': 200} Nov 16 03:27:51.466372 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168787c3-589c-4a9b-815b-05d6d06a951e req-dde7b056-ae93-4df1-b3e6-b9dd22305a98 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:51.467898 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-168787c3-589c-4a9b-815b-05d6d06a951e req-dde7b056-ae93-4df1-b3e6-b9dd22305a98 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0522428 Nov 16 03:27:51.536223 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:51.545961 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-168787c3-589c-4a9b-815b-05d6d06a951e req-c347deb6-7585-41f4-99e9-a98a07ff4f92 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658791 Nov 16 03:27:51.548694 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-109079f3-e424-4b9b-a4e0-4dda761b6bf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:51.551029 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-109079f3-e424-4b9b-a4e0-4dda761b6bf7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2ea0808579e44cdcaeba4109bc12863b&device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 1099 time: 0.0783443 Nov 16 03:27:51.594112 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:51.619973 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:51.646878 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] Checking router: 95164b65-5103-4ebd-944c-7883a34b1f32 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:51.648832 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-d785f211-0cf9-48b5-84e6-6672089af69b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:51.650358 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-d785f211-0cf9-48b5-84e6-6672089af69b service neutron] 10.222.0.11 "GET /v2.0/networks?id=55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 200 len: 909 time: 0.0916836 Nov 16 03:27:51.655101 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:51.655722 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:51.694186 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-1c4ed712-2351-4de3-81b0-4e98f33555b5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 200 len: 217 time: 0.0349798 Nov 16 03:27:51.753595 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-33cd31dd-6e76-42e8-a849-77432457c071 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:51.755238 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-33cd31dd-6e76-42e8-a849-77432457c071 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 200 len: 847 time: 0.0527811 Nov 16 03:27:51.762986 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:51.807924 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-0ba8c1b8-6ed1-4e9d-b08f-63e788974a88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:51.807924 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-0ba8c1b8-6ed1-4e9d-b08f-63e788974a88 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=55d54831-cf2b-4880-8018-9fcb1b176026&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433910 Nov 16 03:27:51.906831 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-5bfb1366-6aab-4258-b4f2-d6095a679fc5 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909324 Nov 16 03:27:51.973036 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:52.000321 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-233a920e-b12b-4fa8-bcfb-c00c4b579f62 None None] The sync data for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi is: [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:23:14Z', 'revision_number': 4, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '978b43ed-a3a9-4d7a-a84a-b769fec14fc7', 'name': '', 'network_id': '55d54831-cf2b-4880-8018-9fcb1b176026', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'mac_address': 'fa:16:3e:b8:3d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_interface', 'standard_attr_id': 601, 'fixed_ips': [{'subnet_id': '23f46016-2284-401d-92a1-617f967a864f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:13Z', 'updated_at': '2021-11-16T03:23:20Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'subnets': [{'id': '23f46016-2284-401d-92a1-617f967a864f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:52.003786 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7c307abf-3e02-4084-87e5-8ddd0a086a33 req-31213bbf-9506-465c-8f48-00ba4e7d4213 service neutron] 10.222.0.11 "GET /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893924 Nov 16 03:27:52.226297 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54d06d26-911d-45e7-a3de-fc5cf39ca52e None None] New status for floating IP e553aab9-91a2-4f73-91d4-0a64f7bc2eed: DOWN {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:27:52.682401 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f78038-83b1-480d-89fd-768c42cb2294 req-a4490ebd-97c2-40f9-a31b-3655f4209493 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:52.683878 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d2f78038-83b1-480d-89fd-768c42cb2294 req-a4490ebd-97c2-40f9-a31b-3655f4209493 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0625932 Nov 16 03:27:52.734858 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d2f78038-83b1-480d-89fd-768c42cb2294 req-3990afd8-4fef-41e6-b224-e539c440ab1b tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/security-groups?id=e87cca3f-4826-407f-8ec0-d093b4170bee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449078 Nov 16 03:27:53.276780 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-4559fab5-5515-4606-9830-550f02757df6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:27:53.278267 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-4559fab5-5515-4606-9830-550f02757df6 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.11 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 946 time: 0.0546269 Nov 16 03:27:53.370543 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Deleting port 338936ea-fa25-4065-9970-6d7171659768 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:53.370879 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:53.469484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] For port 338936ea-fa25-4065-9970-6d7171659768, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=338936ea-fa25-4065-9970-6d7171659768,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:53.469980 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:53.484809 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Calling delete_port for 338936ea-fa25-4065-9970-6d7171659768 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:53.620903 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:53.653237 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event deleted for resources: {'Port': ['ID=338936ea-fa25-4065-9970-6d7171659768,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:53.695936 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] No DVR routers for this DVR port 338936ea-fa25-4065-9970-6d7171659768 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:53.698414 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:53.701779 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4d2a4bed-751d-40e5-9083-904a3ad1cddb req-ba70765c-c511-4572-8f58-9f5dcdc65d17 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.11 "DELETE /v2.0/ports/338936ea-fa25-4065-9970-6d7171659768 HTTP/1.1" status: 204 len: 173 time: 0.4159043 Nov 16 03:27:53.702215 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-deleted', 'tag': '338936ea-fa25-4065-9970-6d7171659768'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:27:53.704424 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d7c239ab-eeff-405c-9239-c3777893640c" -d '{"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-deleted", "tag": "338936ea-fa25-4065-9970-6d7171659768"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:27:53.741965 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:27:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0669766d-42db-4eb8-80ec-cefef183b59b x-openstack-request-id: req-0669766d-42db-4eb8-80ec-cefef183b59b {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:27:53.742251 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7a150a5c-e73e-4eb7-b695-6ec35508ff18", "name": "network-vif-deleted", "tag": "338936ea-fa25-4065-9970-6d7171659768", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:27:53.742496 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-0669766d-42db-4eb8-80ec-cefef183b59b {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:27:53.742899 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7a150a5c-e73e-4eb7-b695-6ec35508ff18', 'name': 'network-vif-deleted', 'tag': '338936ea-fa25-4065-9970-6d7171659768', 'status': 'completed', 'code': 200} Nov 16 03:27:53.841293 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-25a44643-42fa-4444-b240-c82302e2b4d3 req-c26156d3-0373-4374-8e31-f0bcd50200bb tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "GET /v2.0/ports?device_id=7a150a5c-e73e-4eb7-b695-6ec35508ff18 HTTP/1.1" status: 200 len: 210 time: 0.0264702 Nov 16 03:27:54.910045 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50764) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:54.969712 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8a46e2ab-18c4-4c3c-9e86-baebbffeeb29 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:54.999168 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8a46e2ab-18c4-4c3c-9e86-baebbffeeb29 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:55.068559 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8a46e2ab-18c4-4c3c-9e86-baebbffeeb29 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:55.071164 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-8a46e2ab-18c4-4c3c-9e86-baebbffeeb29 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:55.072365 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-8a46e2ab-18c4-4c3c-9e86-baebbffeeb29 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] 10.222.0.31 "DELETE /v2.0/security-groups/e87cca3f-4826-407f-8ec0-d093b4170bee HTTP/1.1" status: 204 len: 168 time: 0.1613030 Nov 16 03:27:55.082496 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a46e2ab-18c4-4c3c-9e86-baebbffeeb29 tempest-TestShelveInstance-1707504604 tempest-TestShelveInstance-1707504604-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e87cca3f-4826-407f-8ec0-d093b4170bee,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:55.130429 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50768) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:55.493279 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:55.795047 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Deleting port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:55.795377 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:55.904915 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] For port 978b43ed-a3a9-4d7a-a84a-b769fec14fc7, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:55.905258 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:55.921207 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Calling delete_port for 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 owned by network:router_interface {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:56.132940 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:56.163248 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Pushing event deleted for resources: {'Port': ['ID=978b43ed-a3a9-4d7a-a84a-b769fec14fc7,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:56.356054 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:56.489515 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:56.513884 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 338936ea-fa25-4065-9970-6d7171659768 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:56.514252 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 338936ea-fa25-4065-9970-6d7171659768 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:56.894089 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Router 95164b65-5103-4ebd-944c-7883a34b1f32 has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101898) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:27:57.008692 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101898) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:27:57.013787 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-0302f514-477c-4d1f-b179-c35d560d3eeb admin admin] 10.222.0.31 "PUT /v2.0/routers/95164b65-5103-4ebd-944c-7883a34b1f32/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8816655 Nov 16 03:27:57.016609 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50774) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:57.017729 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] Sync routers for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:27:57.027500 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:57.028127 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:57.125026 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks [] for router, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.139662 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:57.232424 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.304351 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Deleting port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:57.304690 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.326669 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152'}], 'enable_snat': True}, 'gw_port_id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:27:56Z', 'revision_number': 5, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port': {'id': 'e40ae40d-0189-4a96-9fa9-5ea4b8ad8490', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 600, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:11Z', 'updated_at': '2021-11-16T03:23:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:57.357955 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] Checking router: 95164b65-5103-4ebd-944c-7883a34b1f32 for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:27:57.368259 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] Routers {'95164b65-5103-4ebd-944c-7883a34b1f32'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:27:57.368888 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['95164b65-5103-4ebd-944c-7883a34b1f32'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:57.388162 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] For port e40ae40d-0189-4a96-9fa9-5ea4b8ad8490, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:57.388441 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.401259 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Calling delete_port for e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 owned by network:router_gateway {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:57.456956 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] Set router 95164b65-5103-4ebd-944c-7883a34b1f32 gateway port host: None {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:27:57.513530 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:27:57Z', 'revision_number': 6, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port_host': None}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:57.546010 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08be1a3e-4e1f-475e-a116-1baaea98cc76 None None] The sync data for ids ['95164b65-5103-4ebd-944c-7883a34b1f32'] in dv-cinder-818037-1-iscsi is: [{'id': '95164b65-5103-4ebd-944c-7883a34b1f32', 'name': 'tempest-TestShelveInstance-701962731-router', 'tenant_id': '2ea0808579e44cdcaeba4109bc12863b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:10Z', 'updated_at': '2021-11-16T03:27:57Z', 'revision_number': 6, 'project_id': '2ea0808579e44cdcaeba4109bc12863b', 'gw_port_host': None}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:27:57.593455 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.618273 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Pushing event deleted for resources: {'Port': ['ID=e40ae40d-0189-4a96-9fa9-5ea4b8ad8490,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:57.680902 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.774902 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.777391 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.822934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.823766 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 95164b65-5103-4ebd-944c-7883a34b1f32 {{(pid=101898) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:27:57.830670 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] Publish callbacks [] for router, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.831874 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-8285983a-17f2-41ca-82ef-b85fc59dcc7a admin admin] 10.222.0.31 "DELETE /v2.0/routers/95164b65-5103-4ebd-944c-7883a34b1f32 HTTP/1.1" status: 204 len: 168 time: 0.8142912 Nov 16 03:27:57.835402 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50776) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:57.889246 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Deleting subnet 23f46016-2284-401d-92a1-617f967a864f {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:27:57.892654 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:57.935654 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.031727 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.093473 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.119779 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=23f46016-2284-401d-92a1-617f967a864f,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:58.123271 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.126575 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-ad1519a2-d1c0-425c-ba25-9e621ef1dc29 admin admin] 10.222.0.31 "DELETE /v2.0/subnets/23f46016-2284-401d-92a1-617f967a864f HTTP/1.1" status: 204 len: 168 time: 0.2901564 Nov 16 03:27:58.129222 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50780) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:58.133039 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5885880e-0e8e-4253-bd4d-05edfa6e832b None None] Network 55d54831-cf2b-4880-8018-9fcb1b176026 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:27:58.256498 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.333933 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Deleting port d3a5a2fa-7f90-4061-a114-c658b9a021d9 {{(pid=101898) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:58.334590 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.403964 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] DHCP port deletion for 55d54831-cf2b-4880-8018-9fcb1b176026 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:27:58.421461 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.db [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] For port d3a5a2fa-7f90-4061-a114-c658b9a021d9, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=d3a5a2fa-7f90-4061-a114-c658b9a021d9,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101898) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:58.421883 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.437551 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.plugin [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Calling delete_port for d3a5a2fa-7f90-4061-a114-c658b9a021d9 owned by network:dhcp {{(pid=101898) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:58.481511 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] Deleting port d3a5a2fa-7f90-4061-a114-c658b9a021d9 {{(pid=101900) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:58.482133 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.554667 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] For port d3a5a2fa-7f90-4061-a114-c658b9a021d9, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=d3a5a2fa-7f90-4061-a114-c658b9a021d9,segment=NetworkSegment(13b9e88b-efa5-4d1d-81ea-971df0ce2a81),segment_id=13b9e88b-efa5-4d1d-81ea-971df0ce2a81)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:58.555108 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.565617 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.610629 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Pushing event deleted for resources: {'Port': ['ID=d3a5a2fa-7f90-4061-a114-c658b9a021d9,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:58.616905 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] No DVR routers for this DVR port d3a5a2fa-7f90-4061-a114-c658b9a021d9 on host dv-cinder-818037-1-iscsi {{(pid=101898) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:58.708111 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.716185 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] Calling delete_port for d3a5a2fa-7f90-4061-a114-c658b9a021d9 owned by network:dhcp {{(pid=101900) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:58.736508 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55d54831-cf2b-4880-8018-9fcb1b176026']}} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:58.747032 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '13b9e88b-efa5-4d1d-81ea-971df0ce2a81') {'for_net_delete': True} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:58.747330 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.services.segments.db [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '13b9e88b-efa5-4d1d-81ea-971df0ce2a81') {} {{(pid=101898) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:27:58.759471 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129419530'] for segment, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.773646 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.780785 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Releasing vlan 349 on physical network physnet1 to pool {{(pid=101898) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:27:58.781203 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-128585750'] for segment, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: Traceback (most recent call last): Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: timer() Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: cb(*args, **kw) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: return func(*args, **kwargs) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: self._notify() Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: self.callback(batched_events) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: event.method(event) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: return f(self, *a, **k) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._get(url).json() Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: return self.request(url, 'GET', **kwargs) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:27:58.783603 dv-cinder-818037-1-iscsi neutron-server[101898]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:27:58.794816 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765'] for port, after_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.821517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] No DVR routers for this DVR port d3a5a2fa-7f90-4061-a114-c658b9a021d9 on host dv-cinder-818037-1-iscsi {{(pid=101900) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:27:58.823123 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b959ad9-054e-4bc7-9601-defda4bca20f None None] Pushing event deleted for resources: {'Port': ['ID=d3a5a2fa-7f90-4061-a114-c658b9a021d9,revision_number=None']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:58.848975 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.858041 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:58.858041 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] 10.222.0.31 "DELETE /v2.0/networks/55d54831-cf2b-4880-8018-9fcb1b176026 HTTP/1.1" status: 204 len: 168 time: 0.7263675 Nov 16 03:27:58.861583 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50782) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:27:58.870178 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15b59695-68ec-4b76-8eef-93f19fc524b4 admin admin] Pushing event deleted for resources: {'Network': ['ID=55d54831-cf2b-4880-8018-9fcb1b176026,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:27:59.323830 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:59.608929 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:59.629163 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Deleting port 43675894-06ff-4b28-988f-09322b5b4dcb {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:27:59.629482 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:59.634271 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:59.634620 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 978b43ed-a3a9-4d7a-a84a-b769fec14fc7 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:59.635027 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:59.655940 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:59.656284 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device e40ae40d-0189-4a96-9fa9-5ea4b8ad8490 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:59.656699 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device d3a5a2fa-7f90-4061-a114-c658b9a021d9 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:27:59.678277 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: d3a5a2fa-7f90-4061-a114-c658b9a021d9 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:27:59.678606 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device d3a5a2fa-7f90-4061-a114-c658b9a021d9 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:27:59.718061 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] For port 43675894-06ff-4b28-988f-09322b5b4dcb, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=43675894-06ff-4b28-988f-09322b5b4dcb,segment=NetworkSegment(948dba33-d4b0-4641-84f6-64602f61b447),segment_id=948dba33-d4b0-4641-84f6-64602f61b447)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:27:59.718453 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:59.733356 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Calling delete_port for 43675894-06ff-4b28-988f-09322b5b4dcb owned by network:router_interface {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:27:59.925685 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:27:59.952267 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Pushing event deleted for resources: {'Port': ['ID=43675894-06ff-4b28-988f-09322b5b4dcb,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:00.147272 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:00.376532 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:28:00.489820 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:28:00.496462 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ddaf0efe-03ee-4f5b-99bf-e614a03ca167 admin admin] 10.222.0.31 "PUT /v2.0/routers/d7cf3d4a-7ecb-4adc-933f-e56913fcc87f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6326020 Nov 16 03:28:00.498050 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50788) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:00.501255 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] Sync routers for ids ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'] in dv-cinder-818037-1-iscsi {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:28:00.512593 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] Routers {'d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:28:00.513325 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:00.609453 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks [] for router, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:00.628060 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] Set router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:28:00.848754 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:27:59Z', 'revision_number': 5, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:00.878623 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] Checking router: d7cf3d4a-7ecb-4adc-933f-e56913fcc87f for host: dv-cinder-818037-1-iscsi {{(pid=101900) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:28:00.889417 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] Routers {'d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101900) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:28:00.890084 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:27:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'], 'active': True} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:01.013278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvr_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] Set router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f gateway port host: dv-cinder-818037-1-iscsi {{(pid=101900) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:28:01.017867 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.078276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Deleting port c24d0c4e-4dd2-4fad-bba5-0e821be0b450 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:28:01.078737 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.173920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] For port c24d0c4e-4dd2-4fad-bba5-0e821be0b450, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:28:01.174213 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.188060 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Calling delete_port for c24d0c4e-4dd2-4fad-bba5-0e821be0b450 owned by network:router_gateway {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:28:01.212490 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_hamode_db [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:27:59Z', 'revision_number': 5, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101900) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:01.245074 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c9194f-78b5-449a-b407-9ccc7313b788 None None] The sync data for ids ['d7cf3d4a-7ecb-4adc-933f-e56913fcc87f'] in dv-cinder-818037-1-iscsi is: [{'id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'name': 'tempest-TestShelveInstance-1917360307-router', 'tenant_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145'}], 'enable_snat': True}, 'gw_port_id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:23:16Z', 'updated_at': '2021-11-16T03:27:59Z', 'revision_number': 5, 'project_id': 'e8cfa442410048ee8abafea0f22e1fa1', 'gw_port': {'id': 'c24d0c4e-4dd2-4fad-bba5-0e821be0b450', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:bb:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7cf3d4a-7ecb-4adc-933f-e56913fcc87f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.145', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:23:17Z', 'updated_at': '2021-11-16T03:23:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}] {{(pid=101900) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:28:01.368153 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.394052 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Pushing event deleted for resources: {'Port': ['ID=c24d0c4e-4dd2-4fad-bba5-0e821be0b450,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:01.460140 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.557547 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.559847 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.609166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.609783 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Fanout notify agent at l3_agent the message router_deleted on router d7cf3d4a-7ecb-4adc-933f-e56913fcc87f {{(pid=101899) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:28:01.615009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.619199 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50792) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:01.619801 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-6ce8e988-346f-47e3-9618-04dadf2ca44c admin admin] 10.222.0.31 "DELETE /v2.0/routers/d7cf3d4a-7ecb-4adc-933f-e56913fcc87f HTTP/1.1" status: 204 len: 168 time: 1.1203918 Nov 16 03:28:01.674036 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_v2 [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Deleting subnet c9103af4-17d4-43a4-b652-54ffc4cebd37 {{(pid=101898) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:28:01.679311 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.723061 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129419571'] for subnet, precommit_delete_associations {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.734872 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 43675894-06ff-4b28-988f-09322b5b4dcb no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:28:01.777517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 43675894-06ff-4b28-988f-09322b5b4dcb {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:28:01.778130 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 43675894-06ff-4b28-988f-09322b5b4dcb not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:28:01.818542 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.884374 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-128585900', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-128616639'] for subnet, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.914201 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c9103af4-17d4-43a4-b652-54ffc4cebd37,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:01.919828 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] Publish callbacks [] for subnet, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:01.926085 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-2de4203a-8174-4dd5-b45a-7de6fbf88dda admin admin] 10.222.0.31 "DELETE /v2.0/subnets/c9103af4-17d4-43a4-b652-54ffc4cebd37 HTTP/1.1" status: 204 len: 168 time: 0.3055928 Nov 16 03:28:01.926351 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50794) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:01.928860 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3b336b6-6d32-4c77-b48d-51367fa74a43 None None] Network 414c4d8f-83b9-4da8-9892-d3997dac8c10 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:28:02.010550 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.072632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Deleting port b27ed6ef-2972-4e23-902e-fe4102c95492 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:28:02.073413 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.158979 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] For port b27ed6ef-2972-4e23-902e-fe4102c95492, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=b27ed6ef-2972-4e23-902e-fe4102c95492,segment=NetworkSegment(948dba33-d4b0-4641-84f6-64602f61b447),segment_id=948dba33-d4b0-4641-84f6-64602f61b447)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:28:02.159603 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.182865 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Calling delete_port for b27ed6ef-2972-4e23-902e-fe4102c95492 owned by network:dhcp {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:28:02.294865 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.319834 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Pushing event deleted for resources: {'Port': ['ID=b27ed6ef-2972-4e23-902e-fe4102c95492,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:02.330025 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] No DVR routers for this DVR port b27ed6ef-2972-4e23-902e-fe4102c95492 on host dv-cinder-818037-1-iscsi {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:28:02.334839 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.335089 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.335420 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.335731 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.336054 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.336378 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.336703 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.337027 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.337350 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.337694 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.338010 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.338322 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:28:02.347590 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acaf41cf-7099-4e8c-8273-f180ffa10929 None None] DHCP port deletion for 414c4d8f-83b9-4da8-9892-d3997dac8c10 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:28:02.418094 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.440257 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['414c4d8f-83b9-4da8-9892-d3997dac8c10']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:02.450634 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '948dba33-d4b0-4641-84f6-64602f61b447') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:02.450923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '948dba33-d4b0-4641-84f6-64602f61b447') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:28:02.462054 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.481601 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.493807 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Releasing vlan 340 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:28:02.494353 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:28:02.496277 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:28:02.555781 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.564629 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.567649 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] 10.222.0.31 "DELETE /v2.0/networks/414c4d8f-83b9-4da8-9892-d3997dac8c10 HTTP/1.1" status: 204 len: 168 time: 0.6399825 Nov 16 03:28:02.580634 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87cbb13-ad19-4913-9b90-4f8db50fd9cd admin admin] Pushing event deleted for resources: {'Network': ['ID=414c4d8f-83b9-4da8-9892-d3997dac8c10,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:02.768870 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50800) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:02.813799 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-f5b3282f-29af-4291-aec0-70554ec525f9 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=2ea0808579e44cdcaeba4109bc12863b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0435581 Nov 16 03:28:02.816418 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50802) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:02.876082 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af3b17db-42d0-442f-9ab5-be6662bdfbdc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.898933 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af3b17db-42d0-442f-9ab5-be6662bdfbdc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.951174 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af3b17db-42d0-442f-9ab5-be6662bdfbdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.954203 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-af3b17db-42d0-442f-9ab5-be6662bdfbdc admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:02.955687 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-af3b17db-42d0-442f-9ab5-be6662bdfbdc admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/c266285f-90a6-468c-b1ea-cbfafbfc6d2d HTTP/1.1" status: 204 len: 168 time: 0.1378696 Nov 16 03:28:02.966155 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3b17db-42d0-442f-9ab5-be6662bdfbdc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c266285f-90a6-468c-b1ea-cbfafbfc6d2d,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:03.338960 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50808) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:03.390787 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-6d4ec5a5-1297-4b4d-b63b-b482d2861697 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=e8cfa442410048ee8abafea0f22e1fa1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0504100 Nov 16 03:28:03.393372 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50810) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:28:03.448435 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c1ca394c-3adb-4a13-b0b0-e4f54b716a28 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:03.472747 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c1ca394c-3adb-4a13-b0b0-e4f54b716a28 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:03.530660 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c1ca394c-3adb-4a13-b0b0-e4f54b716a28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:03.533924 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-c1ca394c-3adb-4a13-b0b0-e4f54b716a28 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:03.535108 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-c1ca394c-3adb-4a13-b0b0-e4f54b716a28 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/4dca61a3-4575-411c-9692-bd656d562ccc HTTP/1.1" status: 204 len: 168 time: 0.1406953 Nov 16 03:28:03.546243 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ca394c-3adb-4a13-b0b0-e4f54b716a28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4dca61a3-4575-411c-9692-bd656d562ccc,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:28:03.644490 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device c24d0c4e-4dd2-4fad-bba5-0e821be0b450 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:28:03.670639 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: c24d0c4e-4dd2-4fad-bba5-0e821be0b450 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:28:03.671014 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device c24d0c4e-4dd2-4fad-bba5-0e821be0b450 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:28:03.671431 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device b27ed6ef-2972-4e23-902e-fe4102c95492 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:28:03.694624 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: b27ed6ef-2972-4e23-902e-fe4102c95492 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:28:03.694962 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device b27ed6ef-2972-4e23-902e-fe4102c95492 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:28:05.968456 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:09.008607 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-08d6d0a6-6a82-4759-815e-06b587ef6c17 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0481982 Nov 16 03:28:09.117300 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-7c5773e3-c1af-4297-8150-08875d87a620 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:09.118864 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-7c5773e3-c1af-4297-8150-08875d87a620 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1099 time: 0.0436165 Nov 16 03:28:09.141799 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:28:09.241653 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-e6057b66-dfac-4f53-8609-96a93e511344 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:09.243115 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-e6057b66-dfac-4f53-8609-96a93e511344 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.1013286 Nov 16 03:28:09.314860 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-4c35d9e5-ee5c-4380-95e9-8b41a99c1969 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 1001 time: 0.0638020 Nov 16 03:28:09.369722 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-042109ea-c3a5-44db-9a5c-9831f0483a21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:09.371137 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-042109ea-c3a5-44db-9a5c-9831f0483a21 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0484562 Nov 16 03:28:09.425396 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-4ebd7f4c-1fbb-4ec9-873d-3282b17c1495 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:09.426920 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-4ebd7f4c-1fbb-4ec9-873d-3282b17c1495 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0479841 Nov 16 03:28:09.523575 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-8a6abe6a-5440-478b-875c-012fd237ccbc service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881925 Nov 16 03:28:09.634142 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-74f49c5c-9c03-489b-8fe6-1063c3048250 req-ad55df1e-4396-411a-a3a1-ffd090a4bfa5 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1030610 Nov 16 03:28:14.367278 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-28325847-ad0d-4084-b328-a19d56500ef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:18.299846 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7480ac3-3b79-40fd-b6eb-476fb93031a4 req-63f4417f-58d6-48d1-aa17-88031c257909 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:18.301374 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d7480ac3-3b79-40fd-b6eb-476fb93031a4 req-63f4417f-58d6-48d1-aa17-88031c257909 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0631111 Nov 16 03:28:18.360542 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d7480ac3-3b79-40fd-b6eb-476fb93031a4 req-85c12dc5-8297-4554-a451-64ab0e1b330a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522857 Nov 16 03:28:18.455094 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-95bd5534-69be-4466-99a2-ae58f914d161 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:19.493134 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23bbf94e-00d4-48a9-bd71-75c26988b789 req-872cccc8-52e8-45e3-82bc-d21b8254a032 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:19.494375 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23bbf94e-00d4-48a9-bd71-75c26988b789 req-872cccc8-52e8-45e3-82bc-d21b8254a032 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0599494 Nov 16 03:28:19.544094 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-23bbf94e-00d4-48a9-bd71-75c26988b789 req-8acd1245-9016-4f29-9853-d82a696329fd tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435393 Nov 16 03:28:19.811106 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:20.673041 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dfb71a-0a3f-43ad-80e0-e06e11901e27 req-5965ea82-c81e-4bdc-84f1-af7af84c196c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:20.674680 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-58dfb71a-0a3f-43ad-80e0-e06e11901e27 req-5965ea82-c81e-4bdc-84f1-af7af84c196c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0575733 Nov 16 03:28:20.733364 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-58dfb71a-0a3f-43ad-80e0-e06e11901e27 req-f3ba3e77-6458-4251-8554-cad40b2ca153 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520005 Nov 16 03:28:21.543899 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:21.593459 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:21.865706 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca240b79-0988-4d65-8a3d-631813f5f49c req-41aae97c-0978-4baa-95bb-21460268a757 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:21.867241 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca240b79-0988-4d65-8a3d-631813f5f49c req-41aae97c-0978-4baa-95bb-21460268a757 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0530279 Nov 16 03:28:21.920021 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca240b79-0988-4d65-8a3d-631813f5f49c req-da28f3ed-8ed2-4073-a8e7-d62ed513391a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460856 Nov 16 03:28:23.056597 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b6c9a7-208c-41cf-9dbe-d493000a8b1d req-8eb88b84-cff0-4849-8dfc-cc98c5a62322 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:23.058164 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-08b6c9a7-208c-41cf-9dbe-d493000a8b1d req-8eb88b84-cff0-4849-8dfc-cc98c5a62322 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0551832 Nov 16 03:28:23.109114 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-08b6c9a7-208c-41cf-9dbe-d493000a8b1d req-5352d306-4eac-48da-b6a0-e60be5e750e3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448256 Nov 16 03:28:24.259564 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d87b3b-6a1f-4b96-ae00-77ff66fb8530 req-3d6840a2-0359-485b-ae5d-f4323f7a686a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:24.261304 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6d87b3b-6a1f-4b96-ae00-77ff66fb8530 req-3d6840a2-0359-485b-ae5d-f4323f7a686a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0695324 Nov 16 03:28:24.313458 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a6d87b3b-6a1f-4b96-ae00-77ff66fb8530 req-9d1b523d-462d-47c1-b719-a93ea826c8f2 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459261 Nov 16 03:28:25.440600 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd2d17e-3696-4b37-8950-7403b3690284 req-8335d976-44fd-4edf-a0a5-5e2e1d271e6e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:25.442124 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fd2d17e-3696-4b37-8950-7403b3690284 req-8335d976-44fd-4edf-a0a5-5e2e1d271e6e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0521240 Nov 16 03:28:25.500579 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1fd2d17e-3696-4b37-8950-7403b3690284 req-05eabaf5-a048-44ef-bb62-ef601748bd0c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501008 Nov 16 03:28:26.634047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe297ae-77d3-40f7-8286-7338749465f3 req-5d0f1b7c-7689-4ab7-8884-6f547b49bb8a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:26.635537 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-efe297ae-77d3-40f7-8286-7338749465f3 req-5d0f1b7c-7689-4ab7-8884-6f547b49bb8a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0588686 Nov 16 03:28:26.686157 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-efe297ae-77d3-40f7-8286-7338749465f3 req-f78e6479-709b-48ca-962c-7b28abaabebb tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420330 Nov 16 03:28:27.809333 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b57fe7c-19e0-4d8c-9390-304b351c6b62 req-303ead30-49ac-4944-9d7a-831ca1612f30 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:27.810666 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b57fe7c-19e0-4d8c-9390-304b351c6b62 req-303ead30-49ac-4944-9d7a-831ca1612f30 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0556133 Nov 16 03:28:27.860647 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-4b57fe7c-19e0-4d8c-9390-304b351c6b62 req-7f1f1417-959c-47a3-9679-a5b794d671aa tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437362 Nov 16 03:28:28.995923 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b5a86-69e5-499d-b80b-35292066b0c9 req-9b1df389-7095-46f5-bc40-bd5e7afbae68 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:28.997459 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bd6b5a86-69e5-499d-b80b-35292066b0c9 req-9b1df389-7095-46f5-bc40-bd5e7afbae68 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0667756 Nov 16 03:28:29.047247 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bd6b5a86-69e5-499d-b80b-35292066b0c9 req-58d07876-9863-4df5-b658-52c121e3c82a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436645 Nov 16 03:28:30.176976 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e97f0c-bd9c-4ded-852c-c4f7eab0252c req-c4696098-a77c-4afb-a023-f507eff2aa76 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:30.178493 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-43e97f0c-bd9c-4ded-852c-c4f7eab0252c req-c4696098-a77c-4afb-a023-f507eff2aa76 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0579937 Nov 16 03:28:30.228381 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-43e97f0c-bd9c-4ded-852c-c4f7eab0252c req-f204419d-e4d3-4970-8215-f668df72c8f2 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437794 Nov 16 03:28:31.353769 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df5bef1-2eeb-47e9-9500-bbdf0ebfee19 req-26317b35-5321-4811-bc73-3cdd8c9a9915 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:31.355332 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0df5bef1-2eeb-47e9-9500-bbdf0ebfee19 req-26317b35-5321-4811-bc73-3cdd8c9a9915 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0553579 Nov 16 03:28:31.408314 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0df5bef1-2eeb-47e9-9500-bbdf0ebfee19 req-c53459f8-d7d0-408f-bf1c-a0434e12885f tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464427 Nov 16 03:28:32.524115 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8297aa3-4bb8-47e0-ab5f-3dc3aabe280f req-6a4e0ded-6c5e-4ddb-bab4-35c03a6fe5e0 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:32.525671 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e8297aa3-4bb8-47e0-ab5f-3dc3aabe280f req-6a4e0ded-6c5e-4ddb-bab4-35c03a6fe5e0 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0485644 Nov 16 03:28:32.576710 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-e8297aa3-4bb8-47e0-ab5f-3dc3aabe280f req-474b9029-cdce-4227-b37e-dbad36de8f27 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448959 Nov 16 03:28:33.706920 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e68c63-fdcf-41b9-b930-46bd89ac4752 req-e187245c-7a5f-4fa2-b4b7-f32b4575f7d3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:33.708410 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-09e68c63-fdcf-41b9-b930-46bd89ac4752 req-e187245c-7a5f-4fa2-b4b7-f32b4575f7d3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0518339 Nov 16 03:28:33.769147 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-09e68c63-fdcf-41b9-b930-46bd89ac4752 req-07199d50-ef26-40c6-b548-b56f32353cf8 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528123 Nov 16 03:28:34.028249 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399a8a0e-7af0-4ced-92cf-60255f19dd45 req-8efe9423-ace4-4f83-8623-de4f55dec7d2 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:34.029845 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-399a8a0e-7af0-4ced-92cf-60255f19dd45 req-8efe9423-ace4-4f83-8623-de4f55dec7d2 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0611498 Nov 16 03:28:34.099743 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-399a8a0e-7af0-4ced-92cf-60255f19dd45 req-20ef1988-6403-4234-b605-eeb0ece31744 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632365 Nov 16 03:28:34.111824 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-b9ff48d2-3ffd-4de5-8222-a34c7974f9de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:34.113108 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-b9ff48d2-3ffd-4de5-8222-a34c7974f9de service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1099 time: 0.0520380 Nov 16 03:28:34.206182 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-9ff1896b-e357-4f16-999d-5ffa7a0c79aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:34.207635 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-9ff1896b-e357-4f16-999d-5ffa7a0c79aa service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.0869856 Nov 16 03:28:34.282223 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-d11756f8-01e4-42f3-8744-cf5c3f64316a service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 1001 time: 0.0677719 Nov 16 03:28:34.332528 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-ec64eb1e-65fe-4e40-818f-a3c82ba9bd05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:34.334046 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-ec64eb1e-65fe-4e40-818f-a3c82ba9bd05 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0442708 Nov 16 03:28:34.385905 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-d8d1aaff-c6dc-4bfc-bf2a-a7e4ed741b8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:34.387382 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-d8d1aaff-c6dc-4bfc-bf2a-a7e4ed741b8f service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0459082 Nov 16 03:28:34.491593 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-003adedb-440b-4cde-89da-cd3972fe6ffd service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0970623 Nov 16 03:28:34.589819 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-c7b864ec-132f-46e8-a622-3be68e94bce0 req-35421085-5e57-40ff-867d-b2d506791954 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912359 Nov 16 03:28:35.235935 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca92f5d3-1593-45d9-ae3a-067080e8db79 req-0ff2f235-8c9b-40b4-b7ef-243e58f77b1d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:35.237451 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca92f5d3-1593-45d9-ae3a-067080e8db79 req-0ff2f235-8c9b-40b4-b7ef-243e58f77b1d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0589340 Nov 16 03:28:35.285643 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ca92f5d3-1593-45d9-ae3a-067080e8db79 req-c642767b-92cd-43c5-93d8-89b9d9e0f9e3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421073 Nov 16 03:28:35.971326 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:36.408455 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da9acaaf-55e1-4773-bf98-fe65f02c34a1 req-7253e348-b1b4-4c89-8082-ff8745a52d18 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:28:36.410721 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da9acaaf-55e1-4773-bf98-fe65f02c34a1 req-7253e348-b1b4-4c89-8082-ff8745a52d18 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0528202 Nov 16 03:28:36.468314 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-da9acaaf-55e1-4773-bf98-fe65f02c34a1 req-b7f20523-d7f1-4ffc-b43d-9bcfa3140ba7 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516734 Nov 16 03:28:44.365263 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-fb0b5361-b5ed-4218-924b-0d943ee331c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:46.141806 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:28:48.450421 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6c5f06c6-0c17-4a42-a897-dfde7735030b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:49.814860 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:51.544004 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:28:51.590605 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:05.966532 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:06.753986 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0d1e47-7b98-4214-af95-0560e0dbcd55 req-5e6af9d3-e1c8-4247-bfb0-fae9f2c3bbae tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:06.755472 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7b0d1e47-7b98-4214-af95-0560e0dbcd55 req-5e6af9d3-e1c8-4247-bfb0-fae9f2c3bbae tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0527463 Nov 16 03:29:06.805040 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-7b0d1e47-7b98-4214-af95-0560e0dbcd55 req-9f4ae0c4-173b-4486-b016-a1498b5943bd tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435281 Nov 16 03:29:07.942522 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eedcfae-0d4b-4463-ae5e-d646c8f9b06e req-67523ec8-b201-43fe-8c97-d795bdd13bbe tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:07.944034 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8eedcfae-0d4b-4463-ae5e-d646c8f9b06e req-67523ec8-b201-43fe-8c97-d795bdd13bbe tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0640523 Nov 16 03:29:07.992681 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-8eedcfae-0d4b-4463-ae5e-d646c8f9b06e req-6e50f9ac-2cca-47e1-bb2a-63f26c1be02d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425615 Nov 16 03:29:09.126347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28402ea2-1397-45b1-b132-8db8954914ca req-0cd527c6-1f68-40c7-bac5-52b9a01d5e30 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:09.127750 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-28402ea2-1397-45b1-b132-8db8954914ca req-0cd527c6-1f68-40c7-bac5-52b9a01d5e30 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0585899 Nov 16 03:29:09.175415 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-28402ea2-1397-45b1-b132-8db8954914ca req-1e43493a-b758-41af-a89b-660c13b10d69 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416296 Nov 16 03:29:10.041792 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-2c134952-a026-4f2d-ae4d-06f6c5e4bcfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:10.043268 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-2c134952-a026-4f2d-ae4d-06f6c5e4bcfb service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1099 time: 0.0444407 Nov 16 03:29:10.175328 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-0715b7d9-b276-4d35-90a3-85be05022ab9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:10.177218 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-0715b7d9-b276-4d35-90a3-85be05022ab9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.1084051 Nov 16 03:29:10.244800 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-511e5201-2433-41f3-acff-05fa52c61dac service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 1001 time: 0.0596364 Nov 16 03:29:10.320116 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-6c773565-fbb6-4049-bdf9-0180ae372179 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:10.321486 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-6c773565-fbb6-4049-bdf9-0180ae372179 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0634780 Nov 16 03:29:10.334229 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eceb0fde-c531-4370-ab12-56b65594009e req-879c3b2d-9abe-4ae4-bb10-5d3be3267dce tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:10.335579 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eceb0fde-c531-4370-ab12-56b65594009e req-879c3b2d-9abe-4ae4-bb10-5d3be3267dce tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0859206 Nov 16 03:29:10.402649 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-d28a31ee-6810-4940-852f-7fc166faa14d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:10.404188 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-d28a31ee-6810-4940-852f-7fc166faa14d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0677314 Nov 16 03:29:10.409508 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-eceb0fde-c531-4370-ab12-56b65594009e req-29bc4d92-a761-45ae-a414-20c7a7efb2c4 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658536 Nov 16 03:29:10.501582 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-b57986b2-6194-4d47-81fc-912d32463e25 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874262 Nov 16 03:29:10.597072 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d24ddef3-ef28-48e8-9269-ad29519c8009 req-1f374a5a-3e48-4aba-a9b2-44dcd578e1c8 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880404 Nov 16 03:29:11.546815 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e095073-3c1c-4e76-ab48-d3422cfaca31 req-7d67584a-ee8d-478d-b5a2-53e3e72ff22b tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:11.548651 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e095073-3c1c-4e76-ab48-d3422cfaca31 req-7d67584a-ee8d-478d-b5a2-53e3e72ff22b tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0563388 Nov 16 03:29:11.604514 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9e095073-3c1c-4e76-ab48-d3422cfaca31 req-a2d7951d-c327-4dda-930e-c3fba6183418 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493820 Nov 16 03:29:12.737352 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d9efb3-86c4-4d1e-b487-78835cf0cd00 req-e12e7a30-84bc-4e93-8476-d8c198c0c7a3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:12.738917 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-95d9efb3-86c4-4d1e-b487-78835cf0cd00 req-e12e7a30-84bc-4e93-8476-d8c198c0c7a3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0564816 Nov 16 03:29:12.791152 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-95d9efb3-86c4-4d1e-b487-78835cf0cd00 req-2b067123-f6f3-43fe-b9f1-004483305660 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435739 Nov 16 03:29:13.915282 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380191c6-50d0-41ab-8927-a79a1f20cfa1 req-da7f7c10-c9c7-4083-bb54-d18e470185e3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:13.916685 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-380191c6-50d0-41ab-8927-a79a1f20cfa1 req-da7f7c10-c9c7-4083-bb54-d18e470185e3 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0547571 Nov 16 03:29:13.968058 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-380191c6-50d0-41ab-8927-a79a1f20cfa1 req-53900e32-6080-41f5-b839-a4de97f2f039 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440550 Nov 16 03:29:14.369915 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5df8ca5b-9b41-40f7-b9de-6ce346a9a8d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:15.095093 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d822485-66ca-4981-8471-21ef8eb47498 req-5cb7b25d-8faf-417c-ab57-06c71a270d5a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:15.096486 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2d822485-66ca-4981-8471-21ef8eb47498 req-5cb7b25d-8faf-417c-ab57-06c71a270d5a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0586283 Nov 16 03:29:15.146068 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2d822485-66ca-4981-8471-21ef8eb47498 req-1e136f93-068b-4008-b49a-0312d8599fba tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435472 Nov 16 03:29:16.284503 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9b7707-2e7d-4254-ba92-4ecb4ef5a984 req-36cca1b9-a6a8-4ef9-94a1-e9ce8e501a7b tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:16.286322 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd9b7707-2e7d-4254-ba92-4ecb4ef5a984 req-36cca1b9-a6a8-4ef9-94a1-e9ce8e501a7b tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0606148 Nov 16 03:29:16.336422 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-dd9b7707-2e7d-4254-ba92-4ecb4ef5a984 req-6502de17-89c0-4630-ae4a-1e16fbd58fcd tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418499 Nov 16 03:29:17.468203 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f12280ba-14ec-4a2f-a7ab-8c81f6889f1c req-09f2ef6e-be25-4caa-881c-187000a00650 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:17.469769 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f12280ba-14ec-4a2f-a7ab-8c81f6889f1c req-09f2ef6e-be25-4caa-881c-187000a00650 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0528736 Nov 16 03:29:17.519639 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-f12280ba-14ec-4a2f-a7ab-8c81f6889f1c req-e09d1e6d-ef57-48c7-b91a-bd536ac02979 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438292 Nov 16 03:29:17.738587 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bada136a-8a75-42cb-b721-0838b86854c6 req-d0df1034-8acb-48b3-bb0e-dfc585809e6c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:17.740103 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bada136a-8a75-42cb-b721-0838b86854c6 req-d0df1034-8acb-48b3-bb0e-dfc585809e6c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0502586 Nov 16 03:29:17.814653 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-bada136a-8a75-42cb-b721-0838b86854c6 req-7670f423-c462-4810-a27e-5d68b770809e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680802 Nov 16 03:29:17.821137 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-5fb693d5-b4e8-42b3-bdc4-6a0436e6b9c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:17.822575 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-5fb693d5-b4e8-42b3-bdc4-6a0436e6b9c3 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 1099 time: 0.0615189 Nov 16 03:29:17.926621 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-2a067b8d-7ca5-4f5d-ac0b-9287ff9c4945 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:17.928003 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-2a067b8d-7ca5-4f5d-ac0b-9287ff9c4945 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.0981178 Nov 16 03:29:18.007409 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-54347303-5337-4fb8-8e57-18de4e960119 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 200 len: 1001 time: 0.0664566 Nov 16 03:29:18.071026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-0fc21109-e63b-4af5-9c13-72d67d4ba0fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:18.073132 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-0fc21109-e63b-4af5-9c13-72d67d4ba0fb service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0579791 Nov 16 03:29:18.129403 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-690c2b58-8fc6-4f7d-a791-9415f1eb28d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:18.130909 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-690c2b58-8fc6-4f7d-a791-9415f1eb28d4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0506592 Nov 16 03:29:18.233854 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-cd3082e9-5173-43fe-a758-29d411bd70dd service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0950396 Nov 16 03:29:18.333708 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-03fe1133-6087-48da-a623-0fdaa5e0a7ae req-b12dfdb0-ad0a-4257-abd6-5d4f04c55499 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932992 Nov 16 03:29:18.460915 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-32f556af-96ae-490a-ade3-a915feef3d88 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:18.938188 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bd4bd4-fbc5-491e-af13-0950070664c4 req-cb226511-b2b9-4693-a3c7-77601c45df2c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:18.939670 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-27bd4bd4-fbc5-491e-af13-0950070664c4 req-cb226511-b2b9-4693-a3c7-77601c45df2c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0520041 Nov 16 03:29:18.989753 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-27bd4bd4-fbc5-491e-af13-0950070664c4 req-7e698f0d-f9ff-40d5-ba96-ca8e9b5ac113 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439606 Nov 16 03:29:19.813865 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:20.284402 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f912f0c-7497-4978-b797-cee00de20c4d req-c24edbd9-9811-45e5-be4e-c934c8d47161 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:20.285801 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1f912f0c-7497-4978-b797-cee00de20c4d req-c24edbd9-9811-45e5-be4e-c934c8d47161 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0626824 Nov 16 03:29:20.338204 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1f912f0c-7497-4978-b797-cee00de20c4d req-dec0d1a1-5d46-4914-bc2d-076f78b82000 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436797 Nov 16 03:29:21.545988 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:21.586774 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:23.145330 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:29:35.980624 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:44.375682 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-53cc3600-3a87-4121-9513-55d3dcbf27d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:48.455487 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-1da551fa-2873-4d59-bed8-9d1874a2682f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:49.820492 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:51.549725 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:51.582194 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:52.678940 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2464609b-a319-44e2-808f-7c6bdd4b3860 req-307acd7a-aa4e-4251-bb5d-396bf7163023 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:52.680486 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2464609b-a319-44e2-808f-7c6bdd4b3860 req-307acd7a-aa4e-4251-bb5d-396bf7163023 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0492232 Nov 16 03:29:52.732266 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-2464609b-a319-44e2-808f-7c6bdd4b3860 req-68874a71-d535-4940-9d1f-55924e7a0178 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443227 Nov 16 03:29:53.858163 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875128a8-633c-423f-a217-a35b696117be req-13a7be78-0f51-4b95-99b6-6ca8290eade6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:53.859641 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-875128a8-633c-423f-a217-a35b696117be req-13a7be78-0f51-4b95-99b6-6ca8290eade6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0535779 Nov 16 03:29:53.914423 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-875128a8-633c-423f-a217-a35b696117be req-e1bf65c5-870b-418e-8053-d7a1657e5a50 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463321 Nov 16 03:29:54.659478 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-4fbb186a-d9ec-4b85-a32b-ad08ecb0f803 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:54.660912 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-4fbb186a-d9ec-4b85-a32b-ad08ecb0f803 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.0574520 Nov 16 03:29:54.770201 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Deleting port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:29:54.770499 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:54.864744 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] For port a95128b4-a01f-412c-b4d9-9d6e78a05ae9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:29:54.865581 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:55.369355 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:55.369695 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:55.369994 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Floating IP 0d621c77-450c-41e1-8ede-1a1506cfa1c9 disassociated. External IP: 172.27.1.15, port: a95128b4-a01f-412c-b4d9-9d6e78a05ae9. Nov 16 03:29:55.370349 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Calling delete_port for a95128b4-a01f-412c-b4d9-9d6e78a05ae9 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:29:55.395620 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa62920-48c7-4602-89c2-d55edb19fb2e req-0c9f86af-d77f-4aa5-9dc8-fb9d944f4eb7 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:55.397136 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9fa62920-48c7-4602-89c2-d55edb19fb2e req-0c9f86af-d77f-4aa5-9dc8-fb9d944f4eb7 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d08eda3-962f-4d09-8dc7-bdd14f355b0f HTTP/1.1" status: 200 len: 946 time: 0.4098499 Nov 16 03:29:55.494357 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-9fa62920-48c7-4602-89c2-d55edb19fb2e req-ba951dd4-8c09-4fea-94a0-e4aa197979ac tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0686052 Nov 16 03:29:55.553387 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:55.584027 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event deleted for resources: {'Port': ['ID=a95128b4-a01f-412c-b4d9-9d6e78a05ae9,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:55.596433 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.596794 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.597129 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.597453 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.597796 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.598141 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.598464 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.598786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.599104 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.599484 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.599733 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.600010 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:55.712564 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Router 434fedcd-dbea-44e4-b250-de8dc3af705a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:29:55.820926 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:29:55.832138 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:29:55.845893 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:29:55.846521 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:29:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:29:55.862990 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] No DVR routers for this DVR port a95128b4-a01f-412c-b4d9-9d6e78a05ae9 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:29:55.865742 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:55.868998 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d5f699d5-f155-49f6-83e8-894f3a50b940 req-7012d938-b541-41ff-8e50-3c88b7751fc5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "DELETE /v2.0/ports/a95128b4-a01f-412c-b4d9-9d6e78a05ae9 HTTP/1.1" status: 204 len: 173 time: 1.2019007 Nov 16 03:29:55.869454 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'name': 'network-vif-deleted', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:29:55.871824 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cefa9f3c-aa6b-4942-b4a9-ad55858e11ae" -d '{"events": [{"server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "name": "network-vif-deleted", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:29:55.954099 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:29:56.169266 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:29:56.188665 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:29:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3627864-7446-4348-94f9-b801419e118d x-openstack-request-id: req-a3627864-7446-4348-94f9-b801419e118d {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:29:56.188987 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d08eda3-962f-4d09-8dc7-bdd14f355b0f", "name": "network-vif-deleted", "tag": "a95128b4-a01f-412c-b4d9-9d6e78a05ae9", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:29:56.189233 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-a3627864-7446-4348-94f9-b801419e118d {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:29:56.189667 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d08eda3-962f-4d09-8dc7-bdd14f355b0f', 'name': 'network-vif-deleted', 'tag': 'a95128b4-a01f-412c-b4d9-9d6e78a05ae9', 'status': 'completed', 'code': 200} Nov 16 03:29:56.196753 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:29:56.205821 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:29:56.206419 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:29:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:29:56.327989 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:29:56.547291 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:29:56.581929 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b15b7-da77-4a9d-a5ee-c0c4ad88aa2f None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:29:56.584744 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50976) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:56.648943 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b88108e4-a3df-4027-b055-574509c2798a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:56.673697 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b88108e4-a3df-4027-b055-574509c2798a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:56.729119 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b88108e4-a3df-4027-b055-574509c2798a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:56.732380 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b88108e4-a3df-4027-b055-574509c2798a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:56.735402 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b88108e4-a3df-4027-b055-574509c2798a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "DELETE /v2.0/security-groups/6f1e7928-7dac-46b0-adc7-3fe97e7b5a49 HTTP/1.1" status: 204 len: 168 time: 0.1486611 Nov 16 03:29:56.738980 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50978) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:56.747625 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88108e4-a3df-4027-b055-574509c2798a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f1e7928-7dac-46b0-adc7-3fe97e7b5a49,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:56.756741 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.api.v2.resource [None req-39bc5d6f-09ad-4ff1-8037-cb907bc45a3d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] show failed (client error): The resource could not be found. Nov 16 03:29:56.761809 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-39bc5d6f-09ad-4ff1-8037-cb907bc45a3d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups/6f1e7928-7dac-46b0-adc7-3fe97e7b5a49 HTTP/1.1" status: 404 len: 347 time: 0.0217290 Nov 16 03:29:56.762018 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50982) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:56.847593 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eacc7cdb-c255-4270-986d-37c28cf699f6 None None] New status for floating IP 0d621c77-450c-41e1-8ede-1a1506cfa1c9: DOWN {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:29:56.893461 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Deleting port 13f0efb6-1e7e-4b8b-8e03-9866cf01681b {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:29:56.894117 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:56.985771 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:56.986569 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.005174 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Calling delete_port for 13f0efb6-1e7e-4b8b-8e03-9866cf01681b owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:29:57.154096 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.180796 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event deleted for resources: {'Port': ['ID=13f0efb6-1e7e-4b8b-8e03-9866cf01681b,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:57.243038 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.246294 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.247557 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-ea7e9704-0801-43bc-8d2f-50c3b67b6f1c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "DELETE /v2.0/floatingips/0d621c77-450c-41e1-8ede-1a1506cfa1c9 HTTP/1.1" status: 204 len: 168 time: 0.4843428 Nov 16 03:29:57.693256 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50986) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:57.697824 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1765199962', 'description': 'tempest-description--1224583255'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:29:57.725065 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.801339 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.808218 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.844040 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.845328 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1510441 Nov 16 03:29:57.847402 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ba228e2-ed57-41cb-8984-baabdc283a98,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:57.848421 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50988) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:57.853643 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'security_group_rule': {'security_group_id': '4ba228e2-ed57-41cb-8984-baabdc283a98', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:29:57.855208 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.855545 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.855882 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.856198 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.856524 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.856934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.857272 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.857630 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.857962 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.858583 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.858813 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.859248 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-527e5dd2-022d-484f-8f69-22be26be4fdf tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:29:57.886709 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.945142 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.950149 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.970564 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5290d2d9-4188-4368-8781-89c9cb2d456b,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:57.979736 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:57.980941 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-175104bd-c035-4b67-987f-dd139d93d6bc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1312943 Nov 16 03:29:57.983866 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 50990) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:57.988474 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'security_group_rule': {'security_group_id': '4ba228e2-ed57-41cb-8984-baabdc283a98', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:29:58.015815 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.073321 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.079199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768533'] for security_group_rule, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.096001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2235ecaa-44fc-4e55-80ce-1a8fbf30f598,revision_number=0']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:58.105073 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.106296 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-97736f45-ee80-461d-9428-1e3111c877ad tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1214719 Nov 16 03:29:58.110217 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 50992) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:29:58.114767 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.v2.base [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'floatingip': {'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf'}} {{(pid=101898) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:29:58.137200 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.240445 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.346445 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.db_base_plugin_common [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Allocated IP 172.27.1.161 (0589aea0-39a1-4e64-bdfc-1695da7bfecf/def32ff7-e3b0-42ad-b7c9-bfe553479a1b/954f25da-2b2b-4df9-9001-8f3963cf9e53) {{(pid=101898) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:29:58.450921 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for port, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.489948 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-128585793'] for port, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.531679 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Network 0589aea0-39a1-4e64-bdfc-1695da7bfecf is already hosted by enough agents. {{(pid=101898) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:29:58.534967 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.scheduler.base_scheduler [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Resources bound (agent type, host, resource id): {{(pid=101898) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:29:58.538544 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Received port after_create {{(pid=101898) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:29:58.543868 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'Port': ['ID=954f25da-2b2b-4df9-9001-8f3963cf9e53,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:58.625552 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.661720 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.825688 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for port, precommit_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.831934 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-128585850'] for port, after_update {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.894063 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'Port': ['ID=954f25da-2b2b-4df9-9001-8f3963cf9e53,revision_number=2']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:29:58.909170 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.925422 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:29:58.926669 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-e13dbae2-df1c-4d25-bb3d-cbf1448b6d9c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8154569 Nov 16 03:29:59.135295 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-cbebff90-d89c-4064-af49-97bc809e2569 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?name=tempest-securitygroup--1765199962&fields=id&tenant_id=d0da71fd700f4fad877f51e2e7d7862e HTTP/1.1" status: 200 len: 267 time: 0.0446768 Nov 16 03:29:59.251198 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-1119bc80-e9cd-4788-8632-37b9c1f73ad8 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:29:59.252660 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-1119bc80-e9cd-4788-8632-37b9c1f73ad8 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 810 time: 0.1097419 Nov 16 03:29:59.270999 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-a1abafce-045a-4996-84b4-77bde55c482a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/quotas/d0da71fd700f4fad877f51e2e7d7862e HTTP/1.1" status: 200 len: 375 time: 0.0098763 Nov 16 03:29:59.283116 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a95128b4-a01f-412c-b4d9-9d6e78a05ae9 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:29:59.308325 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: a95128b4-a01f-412c-b4d9-9d6e78a05ae9 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:29:59.308665 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device a95128b4-a01f-412c-b4d9-9d6e78a05ae9 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:29:59.334316 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-44432d87-7375-4af7-addc-1cf0b7df37b1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0551572 Nov 16 03:29:59.557010 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-7c7e2241-bef7-4677-9fb9-d4e906bcfca5 service neutron] 10.222.0.31 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2107723 Nov 16 03:29:59.655281 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-04ad472b-179a-4745-abbb-c1c3640418e4 service neutron] 10.222.0.31 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917997 Nov 16 03:29:59.821452 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-a3affb85-7677-4001-b789-3fb8cb0f8aab req-fa3fa548-560f-4742-ba96-d386aebeccbe tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 210 time: 0.0267246 Nov 16 03:30:00.144358 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:30:00.914999 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-2b41caf6-ad20-44b5-b839-abe2719d630c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:00.916544 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-2b41caf6-ad20-44b5-b839-abe2719d630c tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 810 time: 0.1202731 Nov 16 03:30:00.931055 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-d57c6339-66e0-4a94-a238-f94297f996b0 req-376b5511-bb90-464f-acfe-c4f27c723e4b tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 210 time: 0.0351427 Nov 16 03:30:00.987673 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-b91ca655-3bc2-49cd-953c-f233333545ba tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d0da71fd700f4fad877f51e2e7d7862e HTTP/1.1" status: 200 len: 380 time: 0.0534644 Nov 16 03:30:00.999472 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'port': {'device_id': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'admin_state_up': True, 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'security_groups': ['4ba228e2-ed57-41cb-8984-baabdc283a98']}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:30:01.114468 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Made reservation on behalf of d0da71fd700f4fad877f51e2e7d7862e for: {'port': 1} {{(pid=101899) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 16 03:30:01.120108 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.249912 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_common [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Allocated IP 172.20.0.5 (c03637ab-b657-4c86-ac98-370101bc4e03/4b91ded4-cd47-4ff5-a654-a81d51bab14e/251c59d1-864f-40e8-8354-2cd6d836d415) {{(pid=101899) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 16 03:30:01.426503 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for port, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.460549 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789857572756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.508041 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Network c03637ab-b657-4c86-ac98-370101bc4e03 is already hosted by enough agents. {{(pid=101899) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 16 03:30:01.511394 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.base_scheduler [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Resources bound (agent type, host, resource id): {{(pid=101899) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 16 03:30:01.516104 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Received port after_create {{(pid=101899) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 16 03:30:01.520051 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event updated for resources: {'Port': ['ID=251c59d1-864f-40e8-8354-2cd6d836d415,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:30:01.572540 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:01.573290 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.592098 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-29dc1af8-2c1d-436f-b1b8-1c68882491c6 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5962324 Nov 16 03:30:01.612048 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Request body: {'port': {'device_id': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:30:01.673931 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.776512 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-e0bb8b67-1a5d-4921-90cf-06fe932c2d28 None None] Provisioning complete for port 251c59d1-864f-40e8-8354-2cd6d836d415 triggered by entity DHCP. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:30:01.777118 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e0bb8b67-1a5d-4921-90cf-06fe932c2d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.812812 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-e0bb8b67-1a5d-4921-90cf-06fe932c2d28 None None] Port 251c59d1-864f-40e8-8354-2cd6d836d415 cannot update to ACTIVE because it is not bound. {{(pid=101900) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 16 03:30:01.941626 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 251c59d1-864f-40e8-8354-2cd6d836d415 {{(pid=101899) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:30:01.949309 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:01.962577 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.provisioning_blocks [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Transition to ACTIVE for port object 251c59d1-864f-40e8-8354-2cd6d836d415 will not be triggered until provisioned by entity L2. {{(pid=101899) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 16 03:30:01.968588 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:02.050893 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Pushing event updated for resources: {'Port': ['ID=251c59d1-864f-40e8-8354-2cd6d836d415,revision_number=2']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:30:02.086329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15f4650d-d3d1-4064-8638-bce271f58d1a req-9c23a35d-0c09-4641-adf3-ecef0fac09b2 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.087907 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-15f4650d-d3d1-4064-8638-bce271f58d1a req-9c23a35d-0c09-4641-adf3-ecef0fac09b2 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 943 time: 0.0867965 Nov 16 03:30:02.175396 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-15f4650d-d3d1-4064-8638-bce271f58d1a req-07c01b3e-60e2-452a-a151-b0579a927b7e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0679996 Nov 16 03:30:02.176182 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Attempting to bind port 251c59d1-864f-40e8-8354-2cd6d836d415 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 16 03:30:02.176518 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Attempting to bind port 251c59d1-864f-40e8-8354-2cd6d836d415 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 16 03:30:02.176870 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Attempting to bind port 251c59d1-864f-40e8-8354-2cd6d836d415 on network c03637ab-b657-4c86-ac98-370101bc4e03 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:30:02.182024 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Port 251c59d1-864f-40e8-8354-2cd6d836d415 on network c03637ab-b657-4c86-ac98-370101bc4e03 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 16 03:30:02.182352 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Attempting to bind port 251c59d1-864f-40e8-8354-2cd6d836d415 on network c03637ab-b657-4c86-ac98-370101bc4e03 {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 16 03:30:02.188425 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Checking agent: {'id': 'b55bb529-81e2-47e6-ad3b-d10ccb17f6d8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'started_at': datetime.datetime(2021, 11, 16, 3, 15, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 16, 3, 29, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 16 03:30:02.188747 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Checking segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101899) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 16 03:30:02.189131 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Bound using segment: {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'} {{(pid=101899) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 16 03:30:02.189744 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.managers [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Bound port: 251c59d1-864f-40e8-8354-2cd6d836d415, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 317, 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03'}}] {{(pid=101899) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 16 03:30:02.189966 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:02.255511 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] For port 251c59d1-864f-40e8-8354-2cd6d836d415, host hv-cinder-81803, cleared binding levels {{(pid=101899) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 16 03:30:02.258816 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] For port 251c59d1-864f-40e8-8354-2cd6d836d415, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=251c59d1-864f-40e8-8354-2cd6d836d415,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101899) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 16 03:30:02.263877 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126058061'] for port, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:02.296880 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.297615 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:02.299029 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] 10.222.0.11 "PUT /v2.0/ports/251c59d1-864f-40e8-8354-2cd6d836d415 HTTP/1.1" status: 200 len: 1093 time: 0.6927862 Nov 16 03:30:02.299490 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:30:02.301814 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec03924b-a84d-4655-b91d-38a1a6ac9584" -d '{"events": [{"name": "network-changed", "server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:30:02.334473 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a894ec69-b468-4bfc-89e2-7e12039e3a06 service neutron] Pushing event updated for resources: {'Port': ['ID=251c59d1-864f-40e8-8354-2cd6d836d415,revision_number=3']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:30:02.347155 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:30:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8c1bebb-b8be-4076-a9ee-6fae5050c003 x-openstack-request-id: req-c8c1bebb-b8be-4076-a9ee-6fae5050c003 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:30:02.347836 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:30:02.348112 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-c8c1bebb-b8be-4076-a9ee-6fae5050c003 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:30:02.348665 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415', 'status': 'completed', 'code': 200} Nov 16 03:30:02.404347 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-d5ddb626-cf0f-4ea9-8768-2378001ff69a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.406168 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-d5ddb626-cf0f-4ea9-8768-2378001ff69a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 1096 time: 0.0433457 Nov 16 03:30:02.459212 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-d8f588f3-57fc-4ffa-8ce8-e8c2f6026b30 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=251c59d1-864f-40e8-8354-2cd6d836d415 HTTP/1.1" status: 200 len: 217 time: 0.0390151 Nov 16 03:30:02.514758 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-dfdd54a2-c57b-41a3-9b22-a3d4c91513c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.516578 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-dfdd54a2-c57b-41a3-9b22-a3d4c91513c9 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0501075 Nov 16 03:30:02.565583 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3488f198-684e-4f6d-9b52-939689437842 req-96a5e883-b3e1-4e50-a2a0-c465af54c376 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.567066 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-96a5e883-b3e1-4e50-a2a0-c465af54c376 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432656 Nov 16 03:30:02.664531 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-2bba3e29-fea0-4e31-8e69-a3c610cbe109 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889101 Nov 16 03:30:02.756160 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-3488f198-684e-4f6d-9b52-939689437842 req-04e9fa35-0e6d-47ee-9f53-ac0de64f3b7a service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846548 Nov 16 03:30:02.891575 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-ada19897-ecea-4092-946e-d348a29fc319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.893090 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-ada19897-ecea-4092-946e-d348a29fc319 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 1096 time: 0.0427685 Nov 16 03:30:02.994504 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-94d028c0-4e66-49ad-826f-abfbff0a9c55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:02.996425 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-94d028c0-4e66-49ad-826f-abfbff0a9c55 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.0951629 Nov 16 03:30:03.042623 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-c9a313c0-e510-4496-9369-291aee6cb4ce service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=251c59d1-864f-40e8-8354-2cd6d836d415 HTTP/1.1" status: 200 len: 217 time: 0.0383842 Nov 16 03:30:03.099991 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-17b59044-bded-4b7e-8c3d-5556e91e59a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:03.101347 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-17b59044-bded-4b7e-8c3d-5556e91e59a5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0508950 Nov 16 03:30:03.156007 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-76041a87-8d62-4444-829a-7f0025abc7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:03.157549 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-76041a87-8d62-4444-829a-7f0025abc7a3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427670 Nov 16 03:30:03.263498 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-f00bcd37-22ed-4f9e-beb1-867d372a3cff service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0967958 Nov 16 03:30:03.349137 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975fde4f-0faa-46b3-ad04-bd9c07eed8ae req-0eaa4595-e362-4a72-af80-94b504347ac1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:03.350724 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-975fde4f-0faa-46b3-ad04-bd9c07eed8ae req-0eaa4595-e362-4a72-af80-94b504347ac1 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 943 time: 0.1013389 Nov 16 03:30:03.394970 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-ec03924b-a84d-4655-b91d-38a1a6ac9584 req-87d2cc6b-f374-400b-b482-c8d8a433a061 service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1182125 Nov 16 03:30:03.418964 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-975fde4f-0faa-46b3-ad04-bd9c07eed8ae req-515b76d8-7481-4901-8bf7-6d3e78f26fcd tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580275 Nov 16 03:30:04.543861 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-268a5fec-d322-4686-bea2-d954bb0c8407 req-833005d7-d52e-444e-ad8d-cca3bedde032 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:04.545331 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-268a5fec-d322-4686-bea2-d954bb0c8407 req-833005d7-d52e-444e-ad8d-cca3bedde032 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 943 time: 0.0535650 Nov 16 03:30:04.597607 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-268a5fec-d322-4686-bea2-d954bb0c8407 req-868a48fe-ad7c-4dfa-a1ab-edc9b1595083 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430841 Nov 16 03:30:05.334368 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 251c59d1-864f-40e8-8354-2cd6d836d415 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=101900) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 16 03:30:05.560610 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 251c59d1-864f-40e8-8354-2cd6d836d415, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=251c59d1-864f-40e8-8354-2cd6d836d415,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:30:05.572277 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Returning: {'device': '251c59d1-864f-40e8-8354-2cd6d836d415', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'port_id': '251c59d1-864f-40e8-8354-2cd6d836d415', 'mac_address': 'fa:16:3e:a7:1b:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 317, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101900) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 16 03:30:05.612314 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:05.627690 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 251c59d1-864f-40e8-8354-2cd6d836d415 {{(pid=101900) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 16 03:30:05.648488 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 251c59d1-864f-40e8-8354-2cd6d836d415, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=251c59d1-864f-40e8-8354-2cd6d836d415,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:30:05.653807 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:05.706158 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=251c59d1-864f-40e8-8354-2cd6d836d415,revision_number=4']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:30:05.713192 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.713573 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.713884 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.714215 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.714552 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.714873 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.715196 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.715519 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.715842 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.716162 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.716483 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.716798 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:30:05.726344 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf5d31d-a899-49bb-bd59-6948c03a6d8b req-73ebf6ec-f2ff-4d66-a57d-d5c51e599f9f tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:05.727828 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1bf5d31d-a899-49bb-bd59-6948c03a6d8b req-73ebf6ec-f2ff-4d66-a57d-d5c51e599f9f tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 944 time: 0.0489125 Nov 16 03:30:05.775956 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1bf5d31d-a899-49bb-bd59-6948c03a6d8b req-b6813ac5-e4e4-40f3-809a-9528cdd95b92 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411127 Nov 16 03:30:05.953963 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] get_ports_and_sgs() called for port_ids ['251c59d1-864f-40e8-8354-2cd6d836d415'] {{(pid=101900) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 16 03:30:06.004116 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:06.909956 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ad4792-00e7-4c18-9dd0-97479e4e00bc req-2704f478-6f66-4409-829b-ac66cebabb3d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:06.911488 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-09ad4792-00e7-4c18-9dd0-97479e4e00bc req-2704f478-6f66-4409-829b-ac66cebabb3d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 944 time: 0.0577433 Nov 16 03:30:06.963594 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-09ad4792-00e7-4c18-9dd0-97479e4e00bc req-3de6543b-e228-4012-9846-510b1c9abb0a tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437593 Nov 16 03:30:07.361933 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 251c59d1-864f-40e8-8354-2cd6d836d415 up at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 16 03:30:07.417940 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning for port 251c59d1-864f-40e8-8354-2cd6d836d415 completed by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 16 03:30:07.422313 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.provisioning_blocks [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Provisioning complete for port 251c59d1-864f-40e8-8354-2cd6d836d415 triggered by entity L2. {{(pid=101900) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 16 03:30:07.422678 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3831236'] for port, provisioning_complete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:07.502810 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3927050'] for port, before_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:07.526244 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415'}] {{(pid=101900) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:30:07.528472 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bc91b82a859444a09b9fc085b4b8605ef98dc16fe9a956d8a08dcad4312a7aea" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1d27475-e77c-4e89-9f4b-7cef35e9f935" -d '{"events": [{"server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "name": "network-vif-plugged", "status": "completed", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415"}]}' {{(pid=101900) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:30:07.541049 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-8a014fed-304c-467c-b873-6864f9192caa None None] For port 251c59d1-864f-40e8-8354-2cd6d836d415, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=251c59d1-864f-40e8-8354-2cd6d836d415,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:30:07.546487 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789858118831', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789857572774', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789857572792'] for port, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:07.596712 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Pushing event updated for resources: {'Port': ['ID=251c59d1-864f-40e8-8354-2cd6d836d415,revision_number=5']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:30:07.784768 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:30:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ec779a9-5d45-4cec-b8d7-dadab1b286f8 x-openstack-request-id: req-1ec779a9-5d45-4cec-b8d7-dadab1b286f8 {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:30:07.785066 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "name": "network-vif-plugged", "status": "completed", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415", "code": 200}]} {{(pid=101900) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:30:07.785292 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-1ec779a9-5d45-4cec-b8d7-dadab1b286f8 {{(pid=101900) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:30:07.785711 dv-cinder-818037-1-iscsi neutron-server[101900]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415', 'code': 200} Nov 16 03:30:08.012075 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbbb0c3b-c776-486f-ac4e-00218df78db9 req-48b143bb-1a98-4123-a30b-f0a6a247e284 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:08.013852 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbbb0c3b-c776-486f-ac4e-00218df78db9 req-48b143bb-1a98-4123-a30b-f0a6a247e284 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 1098 time: 0.0419354 Nov 16 03:30:08.094399 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-fbbb0c3b-c776-486f-ac4e-00218df78db9 req-7f5fbc52-1c4f-4966-a6e7-6d20cb3d969e service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0723407 Nov 16 03:30:08.108910 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa462ff-1f35-4e7a-bd43-95bf2400b093 req-3fd730bd-944c-4a2e-b5c2-0ac6d091ef5e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:08.110850 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0aa462ff-1f35-4e7a-bd43-95bf2400b093 req-3fd730bd-944c-4a2e-b5c2-0ac6d091ef5e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0751343 Nov 16 03:30:08.160691 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0aa462ff-1f35-4e7a-bd43-95bf2400b093 req-8a05a25d-ff9e-43e4-91ea-da0593a851ac tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438726 Nov 16 03:30:09.301219 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7bb3de0-7b54-46da-aced-d90e585138a6 req-fcce1156-12d2-4fc4-b74f-0fc8e7b2ec2f tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:09.302769 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b7bb3de0-7b54-46da-aced-d90e585138a6 req-fcce1156-12d2-4fc4-b74f-0fc8e7b2ec2f tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0515783 Nov 16 03:30:09.358994 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-b7bb3de0-7b54-46da-aced-d90e585138a6 req-ce43009b-1b11-4ca8-907d-691c056c56df tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496006 Nov 16 03:30:09.998032 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-000c3bb3-0948-48dd-9a95-d201ef471d7c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0431762 Nov 16 03:30:10.109102 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92607273-7fa9-4caf-9dd4-392de944da63 req-7e39e018-398a-4094-bfd9-204f02c8b4f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:10.111395 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-7e39e018-398a-4094-bfd9-204f02c8b4f2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 1098 time: 0.0481660 Nov 16 03:30:10.237472 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92607273-7fa9-4caf-9dd4-392de944da63 req-78d49c28-bcfd-43d0-b06d-84ed196697e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:10.238965 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-78d49c28-bcfd-43d0-b06d-84ed196697e3 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.1005545 Nov 16 03:30:10.284092 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-2434210e-f99f-4ef5-8171-0c563d903406 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=251c59d1-864f-40e8-8354-2cd6d836d415 HTTP/1.1" status: 200 len: 217 time: 0.0377376 Nov 16 03:30:10.335704 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92607273-7fa9-4caf-9dd4-392de944da63 req-9a59212a-6c97-4f04-b1a6-2eba07dfc007 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:10.336803 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-9a59212a-6c97-4f04-b1a6-2eba07dfc007 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0453665 Nov 16 03:30:10.384498 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92607273-7fa9-4caf-9dd4-392de944da63 req-f6b26fcb-2432-4928-8001-e22b3cc67d92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:10.386012 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-f6b26fcb-2432-4928-8001-e22b3cc67d92 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419602 Nov 16 03:30:10.516317 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757cde22-f544-4b65-a81c-69d394b219c3 req-834eb45e-d48d-42b5-a1ef-f80e0b6910ff tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:10.518847 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-757cde22-f544-4b65-a81c-69d394b219c3 req-834eb45e-d48d-42b5-a1ef-f80e0b6910ff tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0789690 Nov 16 03:30:10.520937 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-47c32fae-eb8e-478c-8ebd-88dd011cef3a service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273844 Nov 16 03:30:10.623528 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-757cde22-f544-4b65-a81c-69d394b219c3 req-272968e8-3957-4210-b6d2-d84612e74eae tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0961349 Nov 16 03:30:10.645986 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-92607273-7fa9-4caf-9dd4-392de944da63 req-d9e8fd89-ef38-49da-a0bc-e56ff9aec5aa service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1171253 Nov 16 03:30:10.744172 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd84c1f-8a1b-4f5f-a007-9890d32b4a1e req-d8e9981c-73d8-44ce-a550-71c9f43863b9 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:10.745679 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-5cd84c1f-8a1b-4f5f-a007-9890d32b4a1e req-d8e9981c-73d8-44ce-a550-71c9f43863b9 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0522132 Nov 16 03:30:10.754641 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51054) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:30:10.759263 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.v2.base [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Request body: {'floatingip': {'port_id': '251c59d1-864f-40e8-8354-2cd6d836d415'}} {{(pid=101899) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 16 03:30:10.798786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, before_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:11.457931 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.db.resource_extend [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] It took 0.31 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 16 03:30:11.512974 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:11.519649 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:11.626337 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Floating IP 79e8713b-2a50-4200-9c52-50484992be5a associated. External IP: 172.27.1.161, port: 251c59d1-864f-40e8-8354-2cd6d836d415. Nov 16 03:30:11.857298 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Router 434fedcd-dbea-44e4-b250-de8dc3af705a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:30:11.972179 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:30:11.979196 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:11.987348 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:30:11.997543 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:30:11.998241 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:29:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:30:12.011674 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-b9e18207-e539-4fce-ad52-f2755bc4bd87 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "PUT /v2.0/floatingips/79e8713b-2a50-4200-9c52-50484992be5a HTTP/1.1" status: 200 len: 991 time: 1.2533627 Nov 16 03:30:12.011674 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:30:12.012225 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e4a82a5-a51c-4620-9684-8eefd521b48c" -d '{"events": [{"name": "network-changed", "server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:30:12.054597 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 16 Nov 2021 03:30:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9421a0d2-9a69-486c-8d47-7376ffc67e85 x-openstack-request-id: req-9421a0d2-9a69-486c-8d47-7376ffc67e85 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:30:12.054872 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:30:12.055117 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-9421a0d2-9a69-486c-8d47-7376ffc67e85 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:30:12.055787 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415', 'status': 'completed', 'code': 200} Nov 16 03:30:12.109016 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:30:12.154620 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-1ff378c5-0c50-4250-b00e-68a8fa44d3f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:12.156222 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-1ff378c5-0c50-4250-b00e-68a8fa44d3f7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 1098 time: 0.0461175 Nov 16 03:30:12.267290 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-16f0b07c-e4b3-4db9-8242-f97fb8cb0015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:12.268791 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-16f0b07c-e4b3-4db9-8242-f97fb8cb0015 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 200 len: 911 time: 0.1025167 Nov 16 03:30:12.339352 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-7566c1b0-da70-4b42-88dc-8fbccec7e46c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=251c59d1-864f-40e8-8354-2cd6d836d415 HTTP/1.1" status: 200 len: 999 time: 0.0616519 Nov 16 03:30:12.342292 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '79e8713b-2a50-4200-9c52-50484992be5a', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'floating_ip_address': '172.27.1.161', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'port_id': '251c59d1-864f-40e8-8354-2cd6d836d415', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 671, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'mac_address': 'fa:16:3e:a7:1b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:29:58Z', 'updated_at': '2021-11-16T03:30:11Z', 'revision_number': 1, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:30:12.370325 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:30:12.379065 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:30:12.379818 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:29:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:30:12.388892 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-989cff19-668b-463d-865c-a84ba3b04274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:12.390400 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-989cff19-668b-463d-865c-a84ba3b04274 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 200 len: 849 time: 0.0442169 Nov 16 03:30:12.443811 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-e7267e95-f7be-48db-8f92-b87bcf3411da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:30:12.445336 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-e7267e95-f7be-48db-8f92-b87bcf3411da service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c03637ab-b657-4c86-ac98-370101bc4e03&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0481284 Nov 16 03:30:12.487146 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:30:12.540718 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-fbd725e9-25d2-456f-a289-2e1c3488d34c service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877280 Nov 16 03:30:12.648244 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-6e4a82a5-a51c-4620-9684-8eefd521b48c req-c7b43dbc-bf8e-40b2-b43f-8a4846fd8cfc service neutron] 10.222.0.11 "GET /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010303 Nov 16 03:30:12.725001 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '79e8713b-2a50-4200-9c52-50484992be5a', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'floating_ip_address': '172.27.1.161', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'port_id': '251c59d1-864f-40e8-8354-2cd6d836d415', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 671, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'mac_address': 'fa:16:3e:a7:1b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:29:58Z', 'updated_at': '2021-11-16T03:30:11Z', 'revision_number': 1, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:30:12.751926 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a915-4ca5-4cf0-bbc0-05f8dfdd11ba None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_floatingips': [{'id': '79e8713b-2a50-4200-9c52-50484992be5a', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'floating_ip_address': '172.27.1.161', 'floating_network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'router_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'port_id': '251c59d1-864f-40e8-8354-2cd6d836d415', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 671, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'mac_address': 'fa:16:3e:a7:1b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-16T03:29:58Z', 'updated_at': '2021-11-16T03:30:11Z', 'revision_number': 1, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:30:12.957069 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f36d67c-b892-4bc3-affe-e8753f62f309 None None] New status for floating IP 79e8713b-2a50-4200-9c52-50484992be5a: ACTIVE {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:30:14.376856 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-d672eeef-6358-4236-b8c9-237752ea53cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:18.464719 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b61ed491-8a12-43c4-83f5-ee53d2c2f7f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:19.820201 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:21.551603 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:21.577891 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:36.004153 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:37.146756 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:30:44.372688 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-bc29744e-dc36-486b-ad79-2868581b7939 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:48.460020 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-f7cf54be-c119-4c12-a66d-31cc02fc5ece None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:49.821396 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:51.553293 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:30:51.585638 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:06.003149 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:09.741632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8d631-b2f2-45fb-b0f4-3b00949a2266 req-d07a1afc-df6d-4878-b807-cf4d99328a98 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:31:09.743149 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aec8d631-b2f2-45fb-b0f4-3b00949a2266 req-d07a1afc-df6d-4878-b807-cf4d99328a98 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0549121 Nov 16 03:31:09.799756 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-aec8d631-b2f2-45fb-b0f4-3b00949a2266 req-b0e49338-6663-40e2-a873-b29e47e4836e tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466294 Nov 16 03:31:10.925272 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9c94f6-814d-44b0-b74a-e60bbb72a97a req-e69b62a5-014c-441c-a811-2fe1224a3326 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:31:10.926750 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1b9c94f6-814d-44b0-b74a-e60bbb72a97a req-e69b62a5-014c-441c-a811-2fe1224a3326 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0543189 Nov 16 03:31:10.996660 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-1b9c94f6-814d-44b0-b74a-e60bbb72a97a req-ef6a1907-3aef-4f40-9e3c-060995e76dfc tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534983 Nov 16 03:31:11.654416 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-6b4b1920-37e4-4068-bc63-1ac83e920a89 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:31:11.655977 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-6b4b1920-37e4-4068-bc63-1ac83e920a89 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.0699978 Nov 16 03:31:11.771626 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Deleting port 251c59d1-864f-40e8-8354-2cd6d836d415 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:31:11.771939 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:11.883030 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] For port 251c59d1-864f-40e8-8354-2cd6d836d415, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=251c59d1-864f-40e8-8354-2cd6d836d415,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:31:11.883390 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:12.062546 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:12.063275 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-670396'] for floatingip, after_update {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:12.063275 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.db.l3_db [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Floating IP 79e8713b-2a50-4200-9c52-50484992be5a disassociated. External IP: 172.27.1.161, port: 251c59d1-864f-40e8-8354-2cd6d836d415. Nov 16 03:31:12.063536 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Calling delete_port for 251c59d1-864f-40e8-8354-2cd6d836d415 owned by compute:nova {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:31:12.181116 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c2ab7d-4ee1-4cd7-b287-796db520df2f req-0ee981c5-a925-43f2-ac0a-cf994e3748a5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101899) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 16 03:31:12.182635 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-56c2ab7d-4ee1-4cd7-b287-796db520df2f req-0ee981c5-a925-43f2-ac0a-cf994e3748a5 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 945 time: 0.1170800 Nov 16 03:31:12.262498 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-56c2ab7d-4ee1-4cd7-b287-796db520df2f req-b04e201e-a6a4-42f5-afad-125e8bc57a83 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups?id=4ba228e2-ed57-41cb-8984-baabdc283a98&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734725 Nov 16 03:31:12.297075 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:12.328116 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event deleted for resources: {'Port': ['ID=251c59d1-864f-40e8-8354-2cd6d836d415,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:12.339074 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.339400 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.339735 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.340186 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.340854 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.341046 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.341357 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.341707 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.342009 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.342350 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.342664 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.342975 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101899) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:12.458304 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Router 434fedcd-dbea-44e4-b250-de8dc3af705a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:31:12.573700 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:31:12.585807 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:31:12.596548 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:31:12.597250 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:30:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:12.613882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] No DVR routers for this DVR port 251c59d1-864f-40e8-8354-2cd6d836d415 on host hv-cinder-81803 {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:31:12.616624 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for port, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:12.620119 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-14bcd285-f2fa-466b-be44-bafe1dd70675 req-ac8acb1e-b3a8-4fad-849e-544c1b7de7ab tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.11 "DELETE /v2.0/ports/251c59d1-864f-40e8-8354-2cd6d836d415 HTTP/1.1" status: 204 len: 173 time: 0.9580195 Nov 16 03:31:12.620561 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'name': 'network-vif-deleted', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415'}] {{(pid=101899) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 16 03:31:12.622910 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.31/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c09674be35e2ef346c3a1835c9dca97dae376c96c4acad13b64a576c2e32e523" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58594019-b5ff-4424-812a-a2d7e8070b3f" -d '{"events": [{"server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "name": "network-vif-deleted", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415"}]}' {{(pid=101899) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 16 03:31:12.670874 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 16 Nov 2021 03:31:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-301da006-e5b2-4324-98e4-2e4c32c32e64 x-openstack-request-id: req-301da006-e5b2-4324-98e4-2e4c32c32e64 {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 16 03:31:12.671262 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b947f1c3-2efd-47ad-b709-90a52dcf9c58", "name": "network-vif-deleted", "tag": "251c59d1-864f-40e8-8354-2cd6d836d415", "status": "completed", "code": 200}]} {{(pid=101899) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 16 03:31:12.671570 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.31/compute/v2.1/os-server-external-events used request id req-301da006-e5b2-4324-98e4-2e4c32c32e64 {{(pid=101899) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 16 03:31:12.672057 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b947f1c3-2efd-47ad-b709-90a52dcf9c58', 'name': 'network-vif-deleted', 'tag': '251c59d1-864f-40e8-8354-2cd6d836d415', 'status': 'completed', 'code': 200} Nov 16 03:31:12.805236 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:31:13.022410 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:13.049376 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:31:13.057781 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:31:13.058382 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:30:48Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:13.168038 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:31:13.369935 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:13.376358 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [req-0b5a7054-e0ff-4ac8-ab15-fc0df3955adb req-4038d165-bef8-44ca-9f52-f939b573eb50 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/ports?device_id=b947f1c3-2efd-47ad-b709-90a52dcf9c58 HTTP/1.1" status: 200 len: 210 time: 0.0279808 Nov 16 03:31:13.402540 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf2d47a9-c587-4bab-9a46-f806c70e1d6c None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:14Z', 'revision_number': 4, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi', '_interfaces': [{'id': '25a1ab15-dc3e-4832-9d11-1fc6c24d8404', 'name': '', 'network_id': 'c03637ab-b657-4c86-ac98-370101bc4e03', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'mac_address': 'fa:16:3e:81:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:14Z', 'updated_at': '2021-11-16T03:27:18Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'subnets': [{'id': '4b91ded4-cd47-4ff5-a654-a81d51bab14e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:31:13.641569 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-746606a4-de6f-48fa-8a29-3a3d4034929c None None] New status for floating IP 79e8713b-2a50-4200-9c52-50484992be5a: DOWN {{(pid=101900) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 16 03:31:14.146606 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:31:14.369308 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-64bf0681-8644-4a43-8cd6-d4d0f1cd963f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.474001 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51266) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:14.533450 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-db7967ea-d913-45d3-bc29-95ef0a42960d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.555681 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-db7967ea-d913-45d3-bc29-95ef0a42960d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.610953 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-db7967ea-d913-45d3-bc29-95ef0a42960d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.613640 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-db7967ea-d913-45d3-bc29-95ef0a42960d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.614714 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-db7967ea-d913-45d3-bc29-95ef0a42960d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "DELETE /v2.0/security-groups/4ba228e2-ed57-41cb-8984-baabdc283a98 HTTP/1.1" status: 204 len: 168 time: 0.1397257 Nov 16 03:31:14.617737 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 51268) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:14.624046 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db7967ea-d913-45d3-bc29-95ef0a42960d tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ba228e2-ed57-41cb-8984-baabdc283a98,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:14.636421 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.api.v2.resource [None req-1ce7d868-9d53-4c5c-94d7-fd22bb372782 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] show failed (client error): The resource could not be found. Nov 16 03:31:14.637506 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-1ce7d868-9d53-4c5c-94d7-fd22bb372782 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "GET /v2.0/security-groups/4ba228e2-ed57-41cb-8984-baabdc283a98 HTTP/1.1" status: 404 len: 347 time: 0.0187113 Nov 16 03:31:14.640671 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51272) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:14.779291 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Deleting port 954f25da-2b2b-4df9-9001-8f3963cf9e53 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:31:14.779712 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.857288 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.857644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:14.869705 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Calling delete_port for 954f25da-2b2b-4df9-9001-8f3963cf9e53 owned by network:floatingip {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:31:15.016644 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:15.040634 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Pushing event deleted for resources: {'Port': ['ID=954f25da-2b2b-4df9-9001-8f3963cf9e53,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:15.106874 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks [] for floatingip, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:15.110846 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-65902'] for floatingip, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:15.112259 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-531af51c-6cbe-4768-8612-82c65c44fe78 tempest-AttachVolumeTestJSON-1256640933 tempest-AttachVolumeTestJSON-1256640933-project] 10.222.0.31 "DELETE /v2.0/floatingips/79e8713b-2a50-4200-9c52-50484992be5a HTTP/1.1" status: 204 len: 168 time: 0.4705718 Nov 16 03:31:15.672122 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 251c59d1-864f-40e8-8354-2cd6d836d415 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:31:15.692409 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8a014fed-304c-467c-b873-6864f9192caa None None] No Port match for: 251c59d1-864f-40e8-8354-2cd6d836d415 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:31:15.692756 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Device 251c59d1-864f-40e8-8354-2cd6d836d415 not bound to the agent host hv-cinder-81803 {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:31:18.465151 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2a858d9c-e8f4-403d-ac94-a3af7eff6c1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:18.704988 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51300) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:19.068732 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-565180'] for router_interface, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:19.322860 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Deleting port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:31:19.323199 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:19.413047 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] For port 25a1ab15-dc3e-4832-9d11-1fc6c24d8404, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:31:19.413451 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:19.425839 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Calling delete_port for 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 owned by network:router_interface {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:31:19.612388 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:19.642272 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Pushing event deleted for resources: {'Port': ['ID=25a1ab15-dc3e-4832-9d11-1fc6c24d8404,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:19.815900 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-605499', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-565192'] for router_interface, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:19.826421 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:20.310882 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Router 434fedcd-dbea-44e4-b250-de8dc3af705a has already been hosted by L3 agent f039ff65-24b6-4259-868c-3b998b6b5499 {{(pid=101899) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 16 03:31:20.430858 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] Notify agent at l3_agent.dv-cinder-818037-1-iscsi the message routers_updated {{(pid=101899) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 16 03:31:20.436820 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-4f5ba19a-39bf-435e-813a-a630e219019b admin admin] 10.222.0.31 "PUT /v2.0/routers/434fedcd-dbea-44e4-b250-de8dc3af705a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7302446 Nov 16 03:31:20.439259 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51302) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:20.441474 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] Sync routers for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 16 03:31:20.452545 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:31:20.453152 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:31:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:20.549409 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks [] for router, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:20.560479 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: dv-cinder-818037-1-iscsi {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:31:20.653721 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:20.710129 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Deleting port dcd7f15e-c124-4a85-8daf-afcd66778542 {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:31:20.710482 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:20.732779 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'external_fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:31:19Z', 'revision_number': 5, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port': {'id': 'dcd7f15e-c124-4a85-8daf-afcd66778542', 'name': '', 'network_id': '0589aea0-39a1-4e64-bdfc-1695da7bfecf', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:58:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 655, 'fixed_ips': [{'subnet_id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:27:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'def32ff7-e3b0-42ad-b7c9-bfe553479a1b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-1-iscsi'}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:20.759192 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] Checking router: 434fedcd-dbea-44e4-b250-de8dc3af705a for host: dv-cinder-818037-1-iscsi {{(pid=101901) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 16 03:31:20.767709 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] Routers {'434fedcd-dbea-44e4-b250-de8dc3af705a'} bound to L3 agent in host dv-cinder-818037-1-iscsi {{(pid=101901) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 16 03:31:20.768314 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-16T03:08:48Z,description=,heartbeat_timestamp=2021-11-16T03:31:18Z,host='dv-cinder-818037-1-iscsi',id=f039ff65-24b6-4259-868c-3b998b6b5499,load=0,resource_versions=,resources_synced=,started_at=2021-11-16T03:08:48Z,topic='l3_agent')) {'router_ids': ['434fedcd-dbea-44e4-b250-de8dc3af705a'], 'active': True} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:20.791335 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] For port dcd7f15e-c124-4a85-8daf-afcd66778542, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=dcd7f15e-c124-4a85-8daf-afcd66778542,segment=NetworkSegment(adc7bcd9-ce4d-4ced-baf2-487066118c1f),segment_id=adc7bcd9-ce4d-4ced-baf2-487066118c1f)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:31:20.791726 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:20.804330 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Calling delete_port for dcd7f15e-c124-4a85-8daf-afcd66778542 owned by network:router_gateway {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:31:20.853175 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_dvr_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] Set router 434fedcd-dbea-44e4-b250-de8dc3af705a gateway port host: None {{(pid=101901) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 16 03:31:20.905706 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.l3_hamode_db [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:31:20Z', 'revision_number': 6, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port_host': None}], 'dv-cinder-818037-1-iscsi', False) {} {{(pid=101901) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:20.940086 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d9e78c6-175c-44a9-865e-127c59165a2d None None] The sync data for ids ['434fedcd-dbea-44e4-b250-de8dc3af705a'] in dv-cinder-818037-1-iscsi is: [{'id': '434fedcd-dbea-44e4-b250-de8dc3af705a', 'name': 'tempest-AttachVolumeTestJSON-979775485-router', 'tenant_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-16T03:27:12Z', 'updated_at': '2021-11-16T03:31:20Z', 'revision_number': 6, 'project_id': 'd0da71fd700f4fad877f51e2e7d7862e', 'gw_port_host': None}] {{(pid=101901) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 16 03:31:20.979301 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.008483 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Pushing event deleted for resources: {'Port': ['ID=dcd7f15e-c124-4a85-8daf-afcd66778542,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:21.076149 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-557426'] for router_gateway, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.167105 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-564624', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-3359'] for router, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.169231 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.213078 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-564617'] for router, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.213659 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 434fedcd-dbea-44e4-b250-de8dc3af705a {{(pid=101899) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 16 03:31:21.218218 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] Publish callbacks [] for router, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.219394 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-720f9464-5940-44c8-960d-4bc24569f64a admin admin] 10.222.0.31 "DELETE /v2.0/routers/434fedcd-dbea-44e4-b250-de8dc3af705a HTTP/1.1" status: 204 len: 168 time: 0.7791781 Nov 16 03:31:21.222273 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51304) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:21.270342 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Deleting subnet 4b91ded4-cd47-4ff5-a654-a81d51bab14e {{(pid=101899) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 16 03:31:21.273778 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.308947 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129335955'] for subnet, precommit_delete_associations {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.396768 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3834066'] for subnet, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.455539 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3834075', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-727696', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126058139', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126233428'] for subnet, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.481075 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b91ded4-cd47-4ff5-a654-a81d51bab14e,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:21.489462 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for subnet, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.495034 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91b9a8c7-9be9-4dd3-bb2c-7d81f7d7634a None None] Network c03637ab-b657-4c86-ac98-370101bc4e03 requested from dv-cinder-818037-1-iscsi {{(pid=101900) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 16 03:31:21.495580 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-1ee5a758-ae73-40ed-9114-160de544350f admin admin] 10.222.0.31 "DELETE /v2.0/subnets/4b91ded4-cd47-4ff5-a654-a81d51bab14e HTTP/1.1" status: 204 len: 168 time: 0.2720597 Nov 16 03:31:21.498798 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51306) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:21.569256 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3953045'] for network, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.578605 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.622510 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.625703 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Deleting port af9aa015-213f-4a14-9dde-26dcbb1b867c {{(pid=101899) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:31:21.626046 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.700307 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.db [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] For port af9aa015-213f-4a14-9dde-26dcbb1b867c, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=af9aa015-213f-4a14-9dde-26dcbb1b867c,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101899) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:31:21.700803 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.717800 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] DHCP port deletion for c03637ab-b657-4c86-ac98-370101bc4e03 request from dv-cinder-818037-1-iscsi {{(pid=101900) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 16 03:31:21.719029 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.plugin [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Calling delete_port for af9aa015-213f-4a14-9dde-26dcbb1b867c owned by network:dhcp {{(pid=101899) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:31:21.771388 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Deleting port af9aa015-213f-4a14-9dde-26dcbb1b867c {{(pid=101900) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 16 03:31:21.771779 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789857948371'] for port, before_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.786724 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:31:21.809873 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126058102'] for port, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.834818 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Pushing event deleted for resources: {'Port': ['ID=af9aa015-213f-4a14-9dde-26dcbb1b867c,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:21.838392 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:31:21.838946 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device 25a1ab15-dc3e-4832-9d11-1fc6c24d8404 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:31:21.839528 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device af9aa015-213f-4a14-9dde-26dcbb1b867c no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:31:21.842063 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] No DVR routers for this DVR port af9aa015-213f-4a14-9dde-26dcbb1b867c on host dv-cinder-818037-1-iscsi {{(pid=101899) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:31:21.865290 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: af9aa015-213f-4a14-9dde-26dcbb1b867c {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:31:21.865657 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device af9aa015-213f-4a14-9dde-26dcbb1b867c not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:31:21.866074 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device dcd7f15e-c124-4a85-8daf-afcd66778542 no longer exists at agent ovs-agent-dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 16 03:31:21.894137 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] No Port match for: dcd7f15e-c124-4a85-8daf-afcd66778542 {{(pid=101900) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 16 03:31:21.894477 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.rpc [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Device dcd7f15e-c124-4a85-8daf-afcd66778542 not bound to the agent host dv-cinder-818037-1-iscsi {{(pid=101900) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 16 03:31:21.902637 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.db [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] For port af9aa015-213f-4a14-9dde-26dcbb1b867c, host dv-cinder-818037-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-1-iscsi',level=0,port_id=af9aa015-213f-4a14-9dde-26dcbb1b867c,segment=NetworkSegment(aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849),segment_id=aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849)] {{(pid=101900) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 16 03:31:21.902637 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-571110'] for port, precommit_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.916871 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.plugins.ml2.plugin [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Calling delete_port for af9aa015-213f-4a14-9dde-26dcbb1b867c owned by network:dhcp {{(pid=101900) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 16 03:31:21.918286 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3833675', 'neutron.services.segments.db._delete_segments_for_network-8789858107594'] for network, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.945382 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c03637ab-b657-4c86-ac98-370101bc4e03']}} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:21.955545 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849') {'for_net_delete': True} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:21.955829 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.services.segments.db [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa8926b6-28f3-4a3f-8c4f-cab8fdbe3849') {} {{(pid=101899) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 16 03:31:21.968700 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789858112723', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129335978'] for segment, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.983329 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691'] for segment, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.989755 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Releasing vlan 317 on physical network physnet1 to pool {{(pid=101899) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 16 03:31:21.990155 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3836691', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126058017'] for segment, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: Traceback (most recent call last): Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: timer() Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: cb(*args, **kw) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: return func(*args, **kwargs) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: self._notify() Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: self.callback(batched_events) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: event.method(event) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: aggregate_uuid = self.p_client.list_aggregates( Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: return f(self, *a, **k) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._get(url).json() Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: return self.request(url, 'GET', **kwargs) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: base_url = self.get_endpoint(auth, allow=allow, Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 16 03:31:21.992056 dv-cinder-818037-1-iscsi neutron-server[101899]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 16 03:31:22.003282 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3927245', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-439383', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789858118813', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789857572765'] for port, after_delete {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.030053 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Pushing event deleted for resources: {'Port': ['ID=af9aa015-213f-4a14-9dde-26dcbb1b867c,revision_number=None']} {{(pid=101900) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:22.036988 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.db.l3_dvrscheduler_db [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] No DVR routers for this DVR port af9aa015-213f-4a14-9dde-26dcbb1b867c on host dv-cinder-818037-1-iscsi {{(pid=101900) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 16 03:31:22.042919 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.043263 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.043599 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.043927 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.044251 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.045034 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.045410 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.045896 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.046180 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.046499 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.046818 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.047134 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035c83c6-d36f-47be-a8a5-8abf5ba26d50 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101900) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:22.056508 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3833680', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768714', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-605440', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-557398'] for network, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.062963 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-605470'] for network, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.066290 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] 10.222.0.31 "DELETE /v2.0/networks/c03637ab-b657-4c86-ac98-370101bc4e03 HTTP/1.1" status: 204 len: 168 time: 0.5664442 Nov 16 03:31:22.077793 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac43d93-bd9e-457d-b7cb-e5d80f92ab9f admin admin] Pushing event deleted for resources: {'Network': ['ID=c03637ab-b657-4c86-ac98-370101bc4e03,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:22.277868 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51310) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:22.319872 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-5edbb3de-9534-4b48-bd72-d6807861eb87 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d0da71fd700f4fad877f51e2e7d7862e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384388 Nov 16 03:31:22.320191 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51312) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:22.378316 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fcb4f138-3d58-4ac4-8888-c44f0afef66d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.399276 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fcb4f138-3d58-4ac4-8888-c44f0afef66d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.456261 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fcb4f138-3d58-4ac4-8888-c44f0afef66d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.459614 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-fcb4f138-3d58-4ac4-8888-c44f0afef66d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:22.461278 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-fcb4f138-3d58-4ac4-8888-c44f0afef66d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ff8ab586-4d54-4614-8a52-ab714313b262 HTTP/1.1" status: 204 len: 168 time: 0.1397996 Nov 16 03:31:22.470757 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb4f138-3d58-4ac4-8888-c44f0afef66d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff8ab586-4d54-4614-8a52-ab714313b262,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:32.076996 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51426) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:32.196786 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-478ccf44-1af8-4514-b7a5-5fd33bf56e37 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.279375 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-478ccf44-1af8-4514-b7a5-5fd33bf56e37 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.286258 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-478ccf44-1af8-4514-b7a5-5fd33bf56e37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.325148 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-478ccf44-1af8-4514-b7a5-5fd33bf56e37 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8a7c839e7ddd448ebbbda823ef12bfbd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2470036 Nov 16 03:31:32.326091 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478ccf44-1af8-4514-b7a5-5fd33bf56e37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c266a31-a508-476b-a6de-000a48d5c21c,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:32.328000 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 51430) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:32.378042 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.399762 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.447232 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.449879 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:32.451016 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/5c266a31-a508-476b-a6de-000a48d5c21c HTTP/1.1" status: 204 len: 168 time: 0.1211960 Nov 16 03:31:32.458783 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c266a31-a508-476b-a6de-000a48d5c21c,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:32.465933 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.466265 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.466633 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.466925 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.467245 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.467566 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.467884 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.468203 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.468519 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.468878 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.469193 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:32.469529 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00fa178e-5130-4684-874a-b43685222526 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-1-iscsi {{(pid=101898) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 16 03:31:36.012064 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:37.602040 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 51524) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:37.725637 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3e95efd6-22b2-487b-821c-7f964e4b33dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:37.811363 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3e95efd6-22b2-487b-821c-7f964e4b33dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:37.817419 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-3e95efd6-22b2-487b-821c-7f964e4b33dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:37.854712 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-3e95efd6-22b2-487b-821c-7f964e4b33dd admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=39fd1a0154bc475fbd671a0e70315773&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2514062 Nov 16 03:31:37.855433 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e95efd6-22b2-487b-821c-7f964e4b33dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ddc50eb3-cd4f-431b-8fac-11a57064fb92,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:37.858150 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51528) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:37.915703 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5dc85b54-c81e-4386-993a-c50c5215cd86 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:37.947548 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5dc85b54-c81e-4386-993a-c50c5215cd86 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.010395 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5dc85b54-c81e-4386-993a-c50c5215cd86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.014037 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-5dc85b54-c81e-4386-993a-c50c5215cd86 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.015627 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-5dc85b54-c81e-4386-993a-c50c5215cd86 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/ddc50eb3-cd4f-431b-8fac-11a57064fb92 HTTP/1.1" status: 204 len: 168 time: 0.1564894 Nov 16 03:31:38.024024 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc85b54-c81e-4386-993a-c50c5215cd86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ddc50eb3-cd4f-431b-8fac-11a57064fb92,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:38.286026 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51534) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:38.303984 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-44383c7d-d083-4abc-a35e-efccb4521329 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.392369 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-44383c7d-d083-4abc-a35e-efccb4521329 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.397732 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-44383c7d-d083-4abc-a35e-efccb4521329 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.437506 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44383c7d-d083-4abc-a35e-efccb4521329 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7d82c75-2fc5-47fc-b690-785b99015ab7,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:38.441924 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-44383c7d-d083-4abc-a35e-efccb4521329 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=d49b9dc90d594df793e972bc2cd747da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1546669 Nov 16 03:31:38.444512 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51536) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:38.492230 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01f6e81f-ce4d-42c4-ab5a-40a7185801b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.514650 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01f6e81f-ce4d-42c4-ab5a-40a7185801b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.566632 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01f6e81f-ce4d-42c4-ab5a-40a7185801b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.570669 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-01f6e81f-ce4d-42c4-ab5a-40a7185801b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:38.572169 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-01f6e81f-ce4d-42c4-ab5a-40a7185801b0 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/f7d82c75-2fc5-47fc-b690-785b99015ab7 HTTP/1.1" status: 204 len: 168 time: 0.1267874 Nov 16 03:31:38.581003 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01f6e81f-ce4d-42c4-ab5a-40a7185801b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7d82c75-2fc5-47fc-b690-785b99015ab7,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:44.362729 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-afc6c088-8669-4d3f-a06a-972a9baa6276 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.570763 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 51618) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:44.683984 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-28d2a504-3b9a-4598-82de-3eadfaa97312 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.775318 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-28d2a504-3b9a-4598-82de-3eadfaa97312 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.783392 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-28d2a504-3b9a-4598-82de-3eadfaa97312 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.821159 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-28d2a504-3b9a-4598-82de-3eadfaa97312 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=89068f7ff64749c5942213dd9e01c551&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2489855 Nov 16 03:31:44.822054 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d2a504-3b9a-4598-82de-3eadfaa97312 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be0edb81-a4a8-4541-aeec-01f215da7c20,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:44.824050 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51622) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:44.875660 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-73cca18e-0a8e-4d85-aa5e-9aba6f9330a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.896767 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-73cca18e-0a8e-4d85-aa5e-9aba6f9330a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.942936 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-73cca18e-0a8e-4d85-aa5e-9aba6f9330a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.945624 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-73cca18e-0a8e-4d85-aa5e-9aba6f9330a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:44.946799 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-73cca18e-0a8e-4d85-aa5e-9aba6f9330a6 admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/be0edb81-a4a8-4541-aeec-01f215da7c20 HTTP/1.1" status: 204 len: 168 time: 0.1217864 Nov 16 03:31:44.954957 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73cca18e-0a8e-4d85-aa5e-9aba6f9330a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be0edb81-a4a8-4541-aeec-01f215da7c20,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:45.226443 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51628) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:45.242537 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-566ce8d8-ce2a-44d9-a556-6b03adbfbd3e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.333277 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-566ce8d8-ce2a-44d9-a556-6b03adbfbd3e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.338553 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-566ce8d8-ce2a-44d9-a556-6b03adbfbd3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.377469 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-566ce8d8-ce2a-44d9-a556-6b03adbfbd3e admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=8540b673e2364c86a1a1dcaa313d546a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1498480 Nov 16 03:31:45.379142 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566ce8d8-ce2a-44d9-a556-6b03adbfbd3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a1caae4-4e09-44bd-a6a7-5b735f6e20b4,revision_number=1']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:45.380335 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 51630) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:45.439537 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad81f6-e92e-47fc-a0bd-1abb4cf3173d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.463269 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad81f6-e92e-47fc-a0bd-1abb4cf3173d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.512500 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad81f6-e92e-47fc-a0bd-1abb4cf3173d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.515093 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-32ad81f6-e92e-47fc-a0bd-1abb4cf3173d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:45.516257 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-32ad81f6-e92e-47fc-a0bd-1abb4cf3173d admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/7a1caae4-4e09-44bd-a6a7-5b735f6e20b4 HTTP/1.1" status: 204 len: 168 time: 0.1349413 Nov 16 03:31:45.525583 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ad81f6-e92e-47fc-a0bd-1abb4cf3173d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a1caae4-4e09-44bd-a6a7-5b735f6e20b4,revision_number=None']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:48.470964 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-bd6a2eef-b261-4f70-ae60-40ee42eadad9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:49.827650 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:51.146196 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:31:51.554770 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:51.576033 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.107817 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.wsgi [-] (101898) accepted ('10.222.0.31', 51716) {{(pid=101898) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:55.219296 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-05756346-2433-4b65-aca4-c4fa7e321e50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.297798 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-05756346-2433-4b65-aca4-c4fa7e321e50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.304626 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron_lib.callbacks.manager [None req-05756346-2433-4b65-aca4-c4fa7e321e50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_create {{(pid=101898) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.344843 dv-cinder-818037-1-iscsi neutron-server[101898]: INFO neutron.wsgi [None req-05756346-2433-4b65-aca4-c4fa7e321e50 admin admin] 10.222.0.31 "GET /v2.0/security-groups?tenant_id=ca62b6fc91484132abc805635f35dce0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2359350 Nov 16 03:31:55.345558 dv-cinder-818037-1-iscsi neutron-server[101898]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05756346-2433-4b65-aca4-c4fa7e321e50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41b60ad2-fa3f-4643-8d42-b2cacd8e1416,revision_number=1']} {{(pid=101898) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:31:55.347919 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [-] (101899) accepted ('10.222.0.31', 51720) {{(pid=101899) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 16 03:31:55.407195 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-598e6c61-3230-401e-8b9f-0ed59bc25ffd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.430166 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-598e6c61-3230-401e-8b9f-0ed59bc25ffd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.484000 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-598e6c61-3230-401e-8b9f-0ed59bc25ffd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-768633'] for security_group, after_delete {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.486662 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron_lib.callbacks.manager [None req-598e6c61-3230-401e-8b9f-0ed59bc25ffd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101899) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:31:55.487849 dv-cinder-818037-1-iscsi neutron-server[101899]: INFO neutron.wsgi [None req-598e6c61-3230-401e-8b9f-0ed59bc25ffd admin admin] 10.222.0.31 "DELETE /v2.0/security-groups/41b60ad2-fa3f-4643-8d42-b2cacd8e1416 HTTP/1.1" status: 204 len: 168 time: 0.1383963 Nov 16 03:31:55.495714 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-598e6c61-3230-401e-8b9f-0ed59bc25ffd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41b60ad2-fa3f-4643-8d42-b2cacd8e1416,revision_number=None']} {{(pid=101899) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 16 03:32:06.021471 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:14.369261 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a2d133ad-1a4e-434e-bba9-8b8ea7bf0b78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:18.477835 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6cad7382-fdd0-47c2-8e3f-e4df1027b80a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:19.830614 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:21.570005 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:21.580488 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:28.149313 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:32:36.023106 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:44.365594 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-64c0178d-d4fe-4d0c-bb66-b29c62eab714 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:48.477953 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-a76d6276-0afd-438e-a65f-d62cd36f69d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:49.835381 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:51.563469 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:32:51.587825 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:05.148832 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:33:06.040002 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:14.369750 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-3fedb0f9-de64-43dc-8bd8-a4ed23b94330 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:18.474517 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2f057ff6-1412-43dd-8ee5-082a587ce054 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:19.837842 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:21.566579 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:21.592131 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:36.040553 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:42.148951 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:33:44.372868 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0acffd39-e782-4d7a-85ad-62e44f81fdc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:48.475326 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-5687302d-308e-476d-9be1-87f8f05c3b46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:49.842395 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:51.569239 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:33:51.596476 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:06.052281 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:14.368943 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6c6308c2-1dd9-4584-8594-987e8224ce96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:18.470783 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-2da7d892-de43-4b6a-8c6c-ef5d1b405fae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:19.149915 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:34:19.846912 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:21.572120 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:21.605405 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:36.047945 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:44.377121 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-6ac48609-a134-40d5-a615-2d786099bfea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:48.467625 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-7eeab565-0176-481b-9bb5-e403ffeb442a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:49.854435 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:51.578153 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:51.603416 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:34:56.151102 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:35:06.062856 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:14.376813 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0a727b54-ca1e-409d-beef-56327e6569d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:18.474109 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-232b1386-72da-4c1e-90b4-fd3e3ece50fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:19.855141 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:21.579478 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:21.596595 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:33.152578 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:35:36.086931 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:44.383351 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-749f77e9-0913-45b8-80c1-c48c43f0ba5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:48.471312 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-f6f1b7d0-7e21-49dd-a609-7cdb79246826 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:49.858652 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:51.588496 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:35:51.602360 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:06.083191 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:06.788674 dv-cinder-818037-1-iscsi neutron-server[101899]: DEBUG neutron.wsgi [req-c5c3f634-8692-4093-98b8-96ac9439a31b req-599cb2b2-8fbf-4f35-bb77-4009cecacaca service neutron] (101899) timed out ('10.222.0.11', 53895) {{(pid=101899) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 16 03:36:10.155355 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:36:14.371794 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e93cc792-89a7-4b69-8efb-1d7e442d3843 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:18.468186 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-0cd43e78-601f-4b37-b8aa-5d653492a6c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:19.858971 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:21.595514 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:21.607410 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:36.087612 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:44.373484 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-b4660a83-63a1-47fa-b6ac-01339879d2e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:47.158236 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 16 03:36:48.472427 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-e186c060-2e4d-47e7-ade8-c5f2dc5ce726 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:49.863046 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:51.602302 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:36:51.617556 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:06.078509 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8a014fed-304c-467c-b873-6864f9192caa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:14.380167 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-40c77538-ab69-4864-9d46-1bac0b07b549 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:18.466696 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-423954cc-bb1c-4ee4-9907-28a05ec34db2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:19.865703 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-04d0499d-6710-446c-9895-76e758c00983 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:21.592889 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-dfd1830f-29bb-4b78-8029-a053b00c14ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:21.610913 dv-cinder-818037-1-iscsi neutron-server[101900]: DEBUG neutron_lib.callbacks.manager [None req-8dc6cc17-b86c-4032-b3a3-abbc20ccc7c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789858107576', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3831189'] for agent, after_update {{(pid=101900) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 16 03:37:24.157921 dv-cinder-818037-1-iscsi neutron-server[101901]: DEBUG neutron.db.agents_db [None req-ed27d409-46f4-4736-a784-365e9e810fd1 None None] Agent healthcheck: found 6 active agents {{(pid=101901) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}